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Introduction 


Functional-analytic methods are of widespread use in pure and applied analysis, 
notably in harmonic analysis, theory of differential and integral equations, probability 
theory, and numerical analysis. In functional analysis one typically works with spaces 
whose points are functions, and uses topological and algebraic methods to study them. 


The syllabus for paper B4 aims to introduce students to the most elementary types 
of functional-analytic reasoning and to teach them to recognise where such reasoning 
is appropriate. The theorems in the course will be illustrated with concrete examples, 
many of these coming as solutions to Finals questions. Each of these questions is set as 
an exercise at an appropriate place in the text. The questions have been included for © 
the convenience of the reader and may be found with suggested solutions in Chapter 6. 


Besides providing a general introduction to the basic ideas of functional-analysis, 
the course gives a thorough elementary treatment of the notion of orthogonality. This 
is carried out in the setting of an infinite-dimensional inner-product space. Orthogonal 
expansions generally, and Fourier series in particular are treated in this context. The 
climax of this part of the course is the spectral theorem for compact self-adjoint opera- 
tors, which is a far reaching generalisation of the diagonalisation theorem for symmetric 
matrices. This has many applications in analysis, especially to differential and integral 
equations. 


My thanks to Dr. Charles Batty for providing a copy of his notes to the first part 
of this course covering Chapter 1. I have tried follow his line of development in this 
chapter. 


Chapter 1 


Normed Vector Spaces 


1.1 Metric Spaces 


We give a brief resumé of some properties of metric spaces. Proofs may be found in 
Sutherland or Kreyszig. 


Let (X,d) be a metric space. A sequence (z,) C X is a Cauchy sequence if given 
€ > 0 there exists N = N, such that 


AU(tn,Lm) < € whenever m,n > N 


If every Cauchy sequence in (X,d) converges to a point of X then (X, d) is complete. 
U c X is d-open if whenever x € U there exists 6 = 6, > 0 such that the ball 
Baz, 6) = {y © X : d(x,y) < 6} C U; ie. U is the union of d-balls. The family 
Ty = {U C X :U is d-open} of all d-open subsets of X is the topology on X induced 
by d. Two metrics d and d' are equivalent if they induce the same topology: Tj = Ty. 


Although continuity is usually expressed in terms of the metric it is a topological 
notion. A map f : (X,d) — (X, d’) is continuous (in the usual €, 6 sense) if and only if 


f~*(U’) is d-open whenever U’ C X’ is d'-open. 
Or, equivalently, if and only if f-'(Ty) C Tq. 


A subspace of (X,d) is a metric space (Y,d) where Y C X. If X is complete then 
~ (Y,d) is complete if and only if Y is a closed subset of X. If a: (X,d) > Sis a function 
from (X,d) onto a set S then S is a quotient space of (X,d) and has a natural metric 
derived from d making 7 continuous. 


We consider now the product of two metric spaces (X,d,) and (X,d2). Although 
there is no natural ‘product metric’ on X, x X2, there is a natural ‘product topology’ 
corresponding to a class of metrics on X, x X2. The metrics 


64 ((x1, 2) = d,(xy, 1) 4 do( x2, y2) 
62((@1,%2)) = (di(e1,y1)? + do(x2, y2)*)” whenever (21,2), (y1, y2) € X1 X X2 
61((21,22)) = max{di(21, 41), dx( x2, y2)} 


on X, x X2 are all equivalent. They have the property that their common topology J; is 
the smallest (weakest, coarsest) for which the coordinate projections 7; : X, x X_ — X; 
are continuous. It is therefore ‘natural’ to choose for a product metric any metric in 
the class of 6;. 


This ‘naturality’ should be taken in the following sense. Given a set with some 
operations, e.g. a group, ring, vector space, product set, the most ‘natural’ topologies 
are those which make the operations continuous. The concepts of topological group, 
topological vector space etc. arise in this way. The particular case of normed vector 
spaces is fundamental to this course. 


1.2 Normed Vector Spaces 


Normed vector spaces occur naturally in many branches of mathematics. In finite 
dimensions they are used for the analysis of errors in numerical analysis. They arise in 
the theory of differential and integral equations, and in the theory of Fourier transforms. 
They are used in quantum theory and differential geometry. In stochastic and ordinary 
control theory they are used for the discussion of various types of stability. 


Let X be a vector space over a field F which may be R or C. We seek a metric 
d on X which is compatible with the algebraic structure of X. For this d should be 
translation invariant and compatible with scalar multiplication. 


Theorem 1.2.1 Let X be a vector space over F. Suppose dis a metric on X satisfying 


D1 d(iz+z,y+z) =d(x,y) = d(x — y,0) = d(y — 2,0) whenever x,y,z € X; 
D2 d(az, ay) = d(a(x — y),0) = jald(z, y) whenever z,y € X anda EF 


Then the formula ||x||¢ = d(z,0) whenever x € X defines a norm on X which satisfies 


N1 I[zllz > 0, 

N2 [z||4 =OS2c=0, 

N3 llaz||a = |a|||x||g whenever a EF and x € X, 

N4 jz + ylla < |lellat |lylla whenever z,y EX (triangle inequality) 
Conversely if || - || : X — [0,co) satisfies N1-N4 then the formula d(z, y) = ||z — y|| 


whenever x,y € X defines a metric satisfying D1 and D2. 


Proof. Property D1 follows from the definitions and then D2 is equivalent to N3. Prop- 
erties N1 and N2 are equivalent to the metric properties d(x,y) > 0 and d(z,y) = 0 if 
and only if x = y. Given these equivalences 


Iz — ylla = d(x — y, 0) = d(x, y) < d(x, 0) + d(0, y) = ||zlla + Ilylla whenever x,y € X 


d(x, y) = lle — yl] = lle -2+2—yl] S lle — 2| + llz — gll = d(e, z) + d{z,y) 
and N4 is equivalent to the triangle inequality for d. = 


Definition 1.2.2 


A norm on a vector space X over F is a map z — ||z|| from X to F satisfying 
N1—N4. The pair (X, || - ||) is then a normed vector space . 


B(0;1) = {x € X : ||z|| < 1} is the open unit ball and B(0;1) = {z € X : |||] < 1} 
the closed unit ball of (X, || - ||). 


U is an open subset of X if for each x € U there exists 6 = 6; > 0 such that 
B(x: 6) ={yEX:||zx—yl] < d} CU. 


The family TJ = {U : U is an open subset of (X, || - ||)} is the norm topology of 
(X, ll -ID- 


Two normed vector spaces (X,|| - ||x) and (Y,]| - |ly) are isomorphic if there is 
a continuous linear bijection j7 : X — Y with continuous inverse, and isometrically 
‘isomorphic if there is a linear bijection j : X — Y such that ||j(z)|ly=||z||x for all 
z € X (j and j~? are automatically continuous). 


The properties D1 and D2 imply that the topology is homogeneous in the sense 
that B(z;¢) = x + €B(0;1) whenever c € X and e > 0. In this way the unit ball 
completely defines the norm the metric and the induced topology. For example if 
(21, r2)|| = (x? + 23)'/? for (21,22) € R? then the unit disc completely defines the 
norm, the Euclidian metric and the usual topology. 


Theorem 1.2.3 If (X,||-|]) is @ normed vector space with corresponding metric d then 
U CX is open if and only if U ts d-open. Thus norm topology Tj, 1s identical with the 
metric topology Ta. 


In referring to a normed vector space the metric is understood. 


Different norms on the same vector space may induce different topologies. Since the 
unit ball completely determines the norm topology it is easy to decide when two norms 
induce the same topologies. 


Definition 1.2.4 


Two norms ||-||, and ||- ||, on a vector space X are equivalent if there exist positive 
constants m,M such that 


mlz|l1 < |lzll2 < Mell whenever x € X 


Theorem 1.2.5 Two norms ||: ||, and ||-|l2 on a vector space X are equivalent if and 
only if they induce the same topology. 


This 13 true tf and only if each of the identity maps 2: (X,|| - |l2) > (X,]]- ||1) and 
2: (X, || - le) > (X, |] - |) 23 continuous. 


Proof. It is immediate that the topologies are identical if and only if both identity maps 
are continuous. 


If U is open for ||- ||; and z € U then there exists 6 = 6, > 0 such that the || - ||a-ball 
B,(;6) C U. But the || - ||2-ball By(x,6/m) C By(x,5) C U and U is || - |]-open. The 


converse is similar. ™ 


As is the case of metric spaces there is no ‘natural’ choice of norm for the product 
X, x X_ of normed vector spaces (X, || - ||,) and (X, || - |l2). The norms 


leah + leat 
(Warall? + [ler2ll2)"/ (1) 


max(||x1]|1, ||r2|l2) 


| 


(21, £2)|| 1) 
I|(z1, 2)||(2) 
II(21, £2) || (00) 


| 


are equivalent norms on X; x Xj. However the topology 7,,oq generated is the smallest 
for which both coordinate projections are continuous. This may be seen as follows. In 
each of the above cases 


Il7i(21, 22)|| = |lzelle < |[(21, za) II 


and 7; is continuous (see the proof of Theorem 1.5.4 and Exercise 1.5.17.) 


Conversely, suppose 71,72 are continuous for some norm || - ||; on X, x X_ with 
topology J;. Then mz*(B,(0;1)) N 77*(B2(0;1)) = Byo.)((0,0);1) is || - {J2-open. It 
follows that any || - ||;-open set is |] - |]..-open and that T,,oq is smaller than Tr. 


It follows from the fact that the metric is compatible with the linear structure that 
the linear operations are continuous. 


Theorem 1.2.6 Let (X,||- ||) be a@ normed vector space over F, and let F x X and 
X x X have any product norm. The following maps are continuous: 


(i) (A, 2) > Ax fromF xX to xX 
(ii) (t,y) > r+y from X x X to X 
(iii) x — ||| from X to [0,co) 


Proof. (i) If (An, 2n) € F x X is convergent to (A,z) then \, converges to \ and zp, 
converges to z. Then 


[nen — Aall = [An(en — 2) + An — Ae] S sup |Asllle — 2] + [An ~ Allie] — 0 
as 2 — OO. 


(ii) Suppose (tn, Yn) € X x X converges to (z,y). Then z, and y, converge to z 
and y. Therefore 


lira |[(tn +9n)—(@+y)l S Jim (len —2|| + [lyn —yll) = Lim ||2,—2|| + lim |Iyn —yl] = 0 


R—-+ OO N—+OO n—+Co NFO 


(iii) Hf 2,y © X with |e — yl] <¢ then [lal] — [lylll < lz — yll < ¢ and 2 = [le] is 
continuous. Hf 


Definition 1.2.7 


A normed vector space (X, || - ||) is complete and is said to be a Banach space if 
X is complete for the induced metric d. 


Definition 1.2.8 A series 0x, in a normed vector space is absolutely convergent 
if > ||zn|| is convergent. 


Theorem 1.2.9 A normed vector space (X,|| - ||) is complete if and only if every 
absolutely convergent series \, 2, in X converges to a vector in X. 


Proof. Suppose (X, || - ||) is complete and oz, is an absolutely convergent series. By 
the Cauchy convergence condition for each € > 0 there exists N = N. € N such that 


k 


dL 


J 


k 
<>) |zn|| < whenever j,k > N 
j 


Therefore s, = Fz, is a Cauchy sequence. Since X is complete there exists s € X 
such that limp. ||sz — s|| = 0 and Sz, = s. 


Conversely suppose that every absolutely convergent series is convergent to a limit 
in X. Let (s,) C X be a Cauchy sequence. For each r there exists N, € N such that 
Ils; — s,|| < 277 whenever j,k > N,. 


We may choose N; < No <... < N, < Nip... If 2, = SN PON. then.) ae 
is absolutely convergent since ), ||z,|| < 727" = 1. Therefore >. 2, converges to 
s€X. Therefore lim,_.. 0} 2, = lim, $n, = $. Since (s,) is Cauchy it follows that 
limyoo $, = s and X is complete. m 


Corollary 1.2.10 (i) A closed subspace (Y,||- ||) of @ Banach space is complete. 


(ii) Jf (Y, || -|]) ts @ complete subspace of a normed vector space (X,||- ||) then Y is 
a closed subset of (X, || - ||). 


Proof. (i) Let 0 yn be an absolutely convergent series in Y. Since X is complete > yp, 
converges to s € X. Since Y is closed s € Y and Y is complete. 


(ii) If y € X is a limit point of Y then there exists a Cauchy sequence (y,) in Y 
convergent to y. Since Y is complete y € Y and Y is closed. 


Example 1.2.11 
Let X =F”. If g =(a1,...2,) € X and put 


Iz = XT lee! 
Izll2 = (I |x, |2)1/” Euclidian norm (1.2) 
[tI] = max, |z,| 


Each of these is a norm on F”. The metric corresponding to the Euclidian norm is the 
Euclidian metric 


d,(x,y) = ||z — yll2= (2 = we) 


If z € F” then 


1/2 
le = mg lee < (Sheu?) = elle S Deal = lala < nlillas whenever 2 € F* 
k k 
and the norms || - |[1, || - [l2, || - ||.. are equivalent. 


In fact all norms on F” are equivalent. By the Bolzano—Weierstrass Theorem F” is 
complete for the Euclidian norm so that F” is a Banach space for all norms. 


Exercise 1.2.12 Finals ’88, Q1. 


If V is an n-dimensional vector space there is a 1 — 1 correspondence between bases 
e of V and linear isomorphisms j, from V onto F”. If e = {e1,...,e,} then j, is given 
by the formula 


je(v) = (x1,...,21) where v = 271, +...¢n€n (uniquely) 


Proposition 1.2.13 Let X be an n-dimensional vector space and let e = {e1,..., en} 
be a basis of X. If ||- || ts a norm on F” then |lv||. = ||7-(v)|| whenever v € V defines 
a norm on V. Conversely if ||- |ly is @ norm on V then ||z||° = ||jz*(z)|lv whenever 
x €F” defines the corresponding norm on F”. 


The maps je: (Vy lle > (F*[l-[l) and dot: (F* I) > (Il liv) are each 


continuous with a continuous inverse. 

Proof. ||- ||. and || - ||° are norms since j, is a linear bijection onto F”. If e > 0 then 
lu — ull. <e if and only if lje(v) —je(u)|]<e foru,veV. 

Therefore j, is continuous with continuous inverse. The proof for j7' is similar. m 


Theorem 1.2.14 Let (V,||- ||) be an n-dimensional normed linear space. If 
e = {e,...,én} is a basis of V then there exist constants0<m<M such that 


Ante eee Seale Neal: 
Whenever x = (21,...,2n) € F”. 
Remark This is equivalent to saying that the norms || - ||. and |] - || are equivalent: 
mlje(v)lla < [el] < M|]-(v) |], whenever v € V. 


We could use |] - |l2 or || - ||.o in place of || - |[1. 


Proof. Assume |le,|| = 1 for all k. By the Heine-Borel theorem the unit sphere S$ = 
{x = (21,..-,2n) EF": |zy|+...+|z,| = 1} in (F",||- |]1) is compact. Let f: 5, oR 
be defined by 


F(x) = f(a1,...,2n) = |ltrer +... + 2nen|| for 2 € Sy 
Then 
If(z) — FY) = Hel —Ilyih| S Ile -ylli<e whenever x,y € 54 with |x — y|| <e 


and f is continuous. This also follows from Theorem 1.2.6. Let M be the maximum 
of f on S; and let f attain its minimum m on S; at x € S;. If m = f(x) = 0 then 
Lo rpex = 0 and zg =0 ¢ S, Therefore m > 0. If0 #2 € F then z/||z|| € S; and 


TyEy Lnen 


lz}: Wall 


Corollary 1.2.15 Any two norms on a finite dimensional vector space X are equiva- 
lent. 


= |[c1€1 +...+ rnen|| Sipe 


eal 


Proof. Let e = {e€1,...,é€n} be a basis for X. It follows from the theorem that any norm 
on X is equivalent to ||j-(-)|| so all norms on X are equivalent. m 


Corollary 1.2.16 The closed unit ball in a finite dimensional normed vector space 
(X, || - ||) ts compact. 


Proof. If X is n-dimensional then it follows from Proposition 1.2.13 and Theorem 1.2.5 
that the closed unit ball in (X, || - ||) is homeomorphic to a closed bounded subset of 
Euclidian space F”, and is therefore compact. m™ 


This corollary has a converse in Theorem 2.2.10 but the proof requires the Hahn- 
Banach Theorem. 


Corollary 1.2.17 (V,||-||) ts @ Banach space. 


Proof. If (v%)) is a Cauchy sequence in V then ml|j.(v) — j-(v)|], < |Jv@ — v®]. 
Therefore j.(v) is Cauchy in (F", || - ||) convergent to j.(v) for some v € V. Then 


lima ||v®) — ol] < lim M]]j-(v) — j-(e)|la = 0, 
j-too Imo 


and (v)) converges to v. = 


Corollary 1.2.18 Any finite dimensional subspace of a normed vector space is closed. 


Corollary 1.2.19 Let B = B(0;1) be the open unit ball for a norm ||-|| on F". Then 
B is 


non-empty (0 € B) 

open (in the Euclidian metric) 

bounded (a subset of B.(0;M) = {x EF”: ||z]l2 < M) 
conver (JA + (1 — A}y|] < 1 whenever 

symmetric (az € B whenever x € B anda € F with |a| = 1) 


Conversely if B is a non-empty bounded open convex symmetric subset of F™ there is a 
unique norm on F” having B is the open unit ball. This norm is given by the formula 


xl] =inf{A >0:2/A€ By =inf{A>0:2€ \B} z EF” (1.3) 


Proof. B is nonempty. The symmetry of B follows since ||az|| = |a|||z|| for all a € F 
and « € F”. 


|Ac + (1 — A)yl] < Alfz]] + (1 — Adly|] <1 whenever 2, y € Baka A € [0,1] 


and B is convex. By Corollary 1.2.15 there exist 0 <m < M ER such that mljz|l, < 
|z|le < M]je||: for all c © F”. If z € B then z € B,(0;M) and B is bounded in the 


Euclidian metric. 


Let x € B with |r|] =1—r. If y € F” with ||z — y|| <r then |ly|| = ||z + y — || < 
{|z||+|ly—2|| <1—r+r=1and B(z;r) C B. Therefore B is open in the || - ||-topology. 
Since all norms on F” induce the same topology B is open in the Euclidian topology. 


Conversely the function ||«|] given by (1.3) is well defined and non-negative. If 
|z|| = 0 then z € AB for all \ > 0 since B is bounded ||z]]2 < \M for all \ > 0 and 
x =0. Therefore N1 and N2 are satisfied. 

If a= re” € F and z € F” then since e~” B = B 

llox|| = inf{A > 0: re’ x/A € B} = rinf{\ > 0:2/A € B} = fala, 
and N3 is satisfied. 


If ||z|| < A and ||y|| < w then ¢ € XB and y € wB. Therefore z+y € (A+ y)B and 
lz + y|| < A+ yp. Therefore ||z + y]| < ||z]] + ||y|| and N4 is satisfied. m 


Exercise 1.2.20 
Let B be a convex symmetric subset of a vector space X such that the set I, = {a: 


ax € B} is the open unit disc in F for each 0 4 ¢ € X. Show that the formula 1.3 
defines a norm on X whose open unit ball is B. 


10 


1.3. Examples 
Example 1.3.1 X =F”. 


The Euclidian norm || - ||, and the norms || - |[j, |] - ||. were defined in (1.2). Every 
|| - |l2-Cauchy sequence (x,) is bounded and, by the Bolzano—Weierstrass Theorem, has 
a subsequence convergent to zc € X . Therefore X is complete for the Euclidian norm. 


All norms on X are equivalent so F” is complete for any norm. 
Example 1.3.2 The Hilbert space ¢? = (?(F). 
This is the ‘obvious’ example of an infinite dimensional Euclidian space. 
The Hilbert space ¢?(F) is the vector space of all sequences x = (xx )e2, with x, € F 


such that }>|x,|? < oo with coordinatewise addition and scalar multiplication. The 
norm on £?(F) is 


z\l2 = (>: jar) wheneves'e @ PUR), 


£?(F) is a complete normed vector space. 
Like Euclidian space £?(F) has an inner product 
(2,9) = > zoe whenever x = (xx), y = (yx) € £(F). 


We must show 
(i) £2? = £°(F) is a vector space. 
(ii) || - || is a norm on ? 


(iii) £2? is complete for |] - |]. 
(i) If z = (a,) € 2 and a € F then az = (ax,) € £?. Moreover 
Yo len + yal? < 52 2(lxe|? + lyx|?) < 00 whenever x = (xz), y= (yx) € 
and £? is a vector space. 


(ii) Suppose x = (z,), y = (yx) € and a EF. Then |laa|| = |a|||x|]. Moreover by 
Minkowski’s inequality 


(Sion) =)" *()” 


for alln EN. Letting n — oo gives ||z + y|l2 < |[z|l2 + lly|l2 and |] - ||2 is a norm. 


BI 


(iii) This will be proved in Theorem 3.2.1. 
Example 1.3.3 ¢'(F) 


Let £' = £1(F) be the vector space of all sequences z = (2;)%° with x, € F such that 
>? [zz] < co. The norm on @! is 


co 


lel = s. |xz| whenever zx = (x;) € 
1 


é' is a complete normed vector space. 
We must show 

(i) £1 = £1(F) is a vector space. 

(ii) || - ]1 is a norm on é! 


(iii) £1 is complete for || - ||1. 


(i)(4i) If « = (az), y = (ye) € £2’ and a € F then az = (az,;) € £1. Moreover 


[oe) 
llax|l, = d)loz,| = loll|ell., 
1 


l|z + ylls = do len + ye| < Do(leel + [yel) = lll] + llyl] < 20 


k=0 k=0 
and 1 is a normed vector space. 


(iii) We use Theorem 1.2.9. Recall (Apostal § 8.22) that if (dm) is a double sequence 
of positive terms then (for finite or infinite sum) 


foe} foe} foe) Loe} 
> yo Gan = os Ss Qmn- 


m=l1nS1 n=1 m=1 


Let >> 2) be an absolutely convergent series in £1. Then 
Leh = COL eP l= OV lel < 0. 
n n ek kon 


Therefore >, |x” | <ooand s,= >, ol”) EC. Let s =(s,). Now 


N-1 fore) foe) foe) 
Dee sl = eS SY el = eel 
k jn=l1 k jin=N k n=N n=N k 


= > Jo™ I, —-0 asN-o. 
n=N 


Therefore 7? 2™ — s € @ with || oY 2 — sl], = rey Ic ||, for all N EN. 
Therefore s € @1 and %, 2”) is convergent to s. By Theorem 1.2.9 £1 is complete. 


Example 1.3.4 €° = £°(F) is a Banach Space. 
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£°° is the vector space of bounded sequences z = (2,)%2, with 2, € F with 
I[tlloo = sup, [zx 

We must show 
(i) 2° is a vector space. 
(ii) |] - ||°° is a norm on £° 
(iii) 2° is complete for |] - ||. 

(i),(4i) If 2 = (x,) and y = (y,) are in £° and a, 8 € F then 

jars + Bys| < lallex| + [llyel < Jed [Ilo + 1A] llylloo for all k 

and |laz + Bylloo < Jal ||zx]loo + |6| Ily|loo- Therefore az + By € £° and £° is a vector 
space. We have also shown that || - ||... satisfies N4. The properties N1,N2, and N3 are 


left as an exercise. 


(iii) We must now show that £° is complete. Suppose >, 2™ is an absolutely 
convergent series in £° and put s™ = "_, 2. Then 3, sup, |2| < 00 and Sy, 2(”) 


is absolutely convergent for all k. If s, = a” < oo for all k. If s = (s,) then 


N-1 ts 

n 
y zy — Sk 
n=1 


yay 
N 


co 
sup = sup < sup >> jo | 
k k kK oN 


< sup |el”| = > Jz oo. 
N &k N 


Therefore s(V-)) — 5 € £° so that s € £°. Moreover [so _ |" STP fe). 3 0 


as N — oo and lim; 8) =P 2 = gs, By Theorem 1.2.9 £° is complete. 
Example 1.3.5 co = co(F) is a Banach Space. 
This is the subspace {x = (z,) € €° : limp... 2% = 0}. Suppose in Example 1.3.4 


that the sequence (x )) lies in co. Given € > 0 there exists N = N, € N such that 
|s~ _ s| < e€ whenever n > N. Since 3%) € cg there exists K = K nie © N such that 


Ise| < € whenever k > K. Therefore 
sup |s,| = sup [sx age ah sf | < sup [sx _ sf + sup Is <e€+|]s — s]] < 2€ 
k>K k>K k>K k>K 


and s E ©. By Theorem 1.2.9 co is complete. 


Example 1.3.6 L' = L'(R) and L'(a,b) are Banach spaces. 
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Let £' be the vector space of Lebesgue integrable functions f : R — R with values 
in F. Let NV C L' be the subspace of null functions. By L* we mean the quotient space 
LIN endowed with the norm ||f||, = f|f| where f = f +N is the equivalence class of 
f. Note that Weir § 7.2 uses L' for both £1 and L'. Now (see Weir § 7.2) 


N1 Sf] 2 0 

N2 flfl=0eof=0ae.6 f=0 

N3 Slofl = lal SFI 

N4 Slf +91 < SUFI + I9l) = S1FL+ S19 


for alla EF, f,g € L! 


and || - ||; is a norm on L’. To prove completeness we need the following theorem. 


Theorem 1.3.7 (Lebesgue’s Series Theorem) Let (f;,) be a sequence in L! such 
that DS \frl < 00. Then > f, converges a.e. tog € Li, and [|X * f,—g| 3 0 as 
n— oo. Moreover fg = ¥° f fe 


Now let 3 f, be an absolutely convergent series in L!. Then 


SllFilh = f lial < 00 


By Lebesgue’s Series Theorem there exists g € L’ such that [poe f= al, — 0 as 
n — oo. It follows from Theorem 1.2.9 that [1 is complete. 


It is conventional to drop the ~ and denote the equivalence class of f by f. 
If (a,b) C R then 
L'(a,b)={f € L’: f(x) =0 for almost all x ¢ (a, b)}. 


The proof above shows that L'(a,b) is complete, so by Corollary 1.2.10 L'(a,b) is a 
closed subspace of L'. 


Example 1.3.8 L? = L?(R) and L?(a,b) are Hilbert spaces. 


Let M be the space of measurable functions on R with values in: F. Then 


s : 1/2 
={feMiN: fel} — with f= (7) 
In Theorem 3.2.3 we show that L? is a Hilbert space. 


If (a,b) C R then L*(a,b) is the subspace (los f : f € L?} c L?. It is a closed 
subspace of L’ and therefore a Hilbert space by Corollary 1.2.10. 


Once again the ~ is dropped and f is denoted by f. 


Example 1.3.9 L° = L*(R) and L*(a, 6) are Banach spaces 
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A measurable function f : R —- F is essentially bounded if 
esssupf = inf{A > 0: |f| < X a.e.} < oo. 
If f is essentially bounded and f = g a.e. then esssup|f| = ess sup|g]. 


L® is the subspace {f € M/N : esssup]|f| < co} of equivalence classes of essentially 
bounded functions with the norm ||f||,, = ess sup]. 


If \ > |fl| and «> |g| ae. then A+ > |f|+ |g] > |ftg| ae. so that |] - ||... satisfies 
N4. Properties N1,N2, and N3 are easily verified. 


Let > f, be an absolutely convergent series in L®. Then Y>, esssup|f,| = S < 00 
and there exists a null set N such that >, sup, cr_y |fn(z)| = S. Therefore 


d fa(2)| S > lfn(z)| = S whenever zc ¢ N 
If s(x) = 4 f, (x) for z ¢ N and zero otherwise then 


= fr(x) 7 s(z)| = 


n=1 


owe 


3 frlz) 


N |n=N 


= =e 


S Yeup [fn(z)| = oF || fulloo 


Therefore >) fr — s € L® so that s € L® and Ste =o 


L®™(a, 6) is the subspace (lias f : f € L@}. The above argument shows it is com- 
plete. 


Example 1.3.10 (C[a, }, || - ll.) and (C(Q), |] - ||.) where 2 is compact are Banach 
spaces. 


C[a, 6] is the vector space of continuous F-valued functions on the compact interval 
[a, b] C R with the norm || f|| = sup{|f(z)| : x € [a, 6]}. 


The verification of properties N1-N4 is similar to that in Examples 1.3.9 and 1.3.4. 
This norm is similar to those on L© and @©. However we will prove completeness 
directly without the use of Theorem 1.2.9. 


If (f,.) be a Cauchy sequence in Ca, }] then (f,(x)) is a Cauchy sequence for each 
xz € [a,b]. Since F is complete (f,(x)) converges to f(z) for each zx € [a, b]. 


If € > 0 there exists N = N, such that 


llfn — fmlloo = ne \fn(z) — fin (z)| < € whenever m,n > N. 


x€[a,b] 


Therefore | f(z) — fm(x)| < € whenever m > N and letting m — oo |fy(z) — f(z)| < € 
for all x € [a,b]. If we can show that f is continuous then || fy — filo < € and (fn) 
converges to f so that Cla, 6] is complete. 
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Suppose Zo € [a,b] and € is as above. Since fy is continuous there exists 6 = 6.,, > 0 
such that | f(x) — fn(2o)| < € whenever |x — zo| < 6. Therefore 


|f(a) — f(xo)| = |f(z) — f(z) + f(x) — fiv(20) + fiv(t0) — f(x0)| 
= |f(z) ~ f(z)| — lfv(z) = frn(20)| oF |fn (xo) = f(o)| < 3e 


whenever |r — zo| < 6 and f is continuous. 


The same is true of C(Q) where 2 is any compact topological space and 


II flloo = supuea lf). 
Example 1.3.11 (C[—1,1],||- ||,): an incomplete normed vector space. 
C[—1,1] is a subspace of L1(—1,1). Let 
0 ifx <0 
Fc} ae LOA se Sn 
1 ifl/n<a2<l 


The sequence (f,) is monotone increasing to f = 1,4. By the MCT 


[o-twe= fif-fl= lt -flh 0 as n — 00 


and (f,) is a Cauchy sequence convergent to f € L'(—1,1). If g € C[—-1,1] such that 
lim, ||fn — gll1 > 0 then || f — gl], = So |f — 9] =0 and f =g ae. 


If 0 < €< 1/2 then there exists 6 = 6, such that |g(x) — g(0)| < € whenever |z| < 6. 
Leth =g—f. lf-6<4<0<y<6 then 


|h(x) — h(y)| = lolz) — o(y) — Fle) + FYI loz) — 9) - IF(@) -— FI > 1. 
But h = 0 ae. so |h| > 1—€ a.e. on [—1, 0] which is a contradiction. 


This shows that the sequence (f,,) in C[—1, 1] is a Cauchy sequence in (C[-—1, 1], ||-||1) 
which does not converge to a vector in C[—1,1]. Therefore (C[—1, 1], |] - |]1) is not 
complete. . 


Exercise 1.3.12 Finals ’89, Q1, 90, Q1. 


1.4 Quotient spaces 


Let (X, |]-||) be a normed vector space and let Y be a linear subspace of X. The quotient 
space X/Y consists of cosets x + Y with x € X and addition and scalar multiplication 
given by 


OCTET EY tena 


Is their a natural way to make X/Y into a normed vector space? 
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An obvious candidate is 
je + ¥|| = inf {lel] 2 © 2 + ¥} = inf {lle — yl sy €Y) = al2,¥) 


the distance from x to Y. It is immediate that ||z +Y|| > 0 so N1 is valid. If z € Y the 
closure of Y then inf{||z — y||: y ¢ Y} =0. If z ¢ Y then there exists 6 > 0 such that 
B(x,6)NY =9. Therefore N2 is valid if and only if Y is closed. This we will assume. 


If x4,22 € X and y,,y2 € ¥Y then 
l[t1 + 22 +Y|[ < [ler + 22 — (4 + ya)il S lea — yall + [Io — yell. 
Taking the infimum first over y; € Y then over yz € Y gives 
(er + Y) + (a2 + Y)I] < |]le1 + Y|] + |]z2 + Y|| whenever 21, 22 € X, 
and N4 is satisfied. If0 # \ € F and z € X then 
|A@e+¥)I] = inf {|[Ae—yl] + y € ¥} = inf{[Allo—y/AI] sy € ¥} = ine {I[lo—yl]: y € Y} 
=|Mlle +71 

and N3 is satisfied (the case \ = 0 is trivial). 
Theorem 1.4.1 Let Y be a closed subspace of a normed vector space X. The formula 

[Iz + Y|| = inf{||x — yl]: y € Y} whenever x € X (1.4) 
defines a norm on X/Y. 


Moreover, if X 18s complete then X/Y is complete. 


Proof. The remarks above show that (1.4) defines a norm. Suppose that (z, + Y) 
is an absolutely convergent sequence in X/Y. For each n there exists y, € Y such 
that ||tn — yall < |len + Y|]+2-". Therefore D, |ltn — yn|| << len +Y|] +1 < co 
and (%n — Yn) is absolutely convergent. If X is complete there exists zc € X such that 
limp-soo DF ||(an — Yn) — 2|| = 0. Therefore 


k 


k 
dLtn 2+ >In 
1 1: 


= 0 


Ltn +Y)-—(¢+Y) 


lim 
k-00 


< lim 
k-00 
and )\(tn + Y) converges tor+yY.m— 


It may be the case that for each « € X there is a point yo € Y such that ||z + Y|| = 
|z — yo||. When X is a Hilbert space yo exists and is unique. This is part of the 
Projection Theorem, Theorem 3.3.13. It may be that yo exists for all x but is not 
unique, or that yo does not exist. We give examples of these possibilities. 


Theorem 1.4.2 If Y is an n-dimensional subspace of a normed vector space (X, ||-|\) 
then for each x € X there exists a vector p(x) € Y such that ||z + Y|| = ||x — p(x)|| 


Proof. Let (yn) C Y be such that lim, .. ||z — yn|| = llc — Y|]. Then (y,) is a Cauchy 
sequence. By Corollary 1.2.15 Y is topologically isomorphic to Euclidian space F”. 
Therefore (y,) has a subsequence (yn, ) convergent to y € Y. Since the norm is contin- 
uous limy+oo ||z — yng] = Ile — yl] = lle - ¥ |. 
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Example 1.4.3 X = £', Y = {y € é': y, =0 whenever r is even} 
Then 
lz + Y|| = inf{lz. — y| + |e2| + [zs — yal +..-: > [Yor-1| < co} 


= |x2|+|r4|+.... 
= |le — yllr where y = (21,0, 23,0, 25,0,...) 


and the infimum is obtained for a. unique y € Y. 
If we define J: X/Y — £' by 
J(a@+Y) = (22, 24,26,...) for s =(z,) € #, 
then ||z + Y|| = ||J(c7 + Y)|| and J is an isometric isomorphism of X/Y onto £1. 
Example 1.4.4 X =", Y = {y € ©: y, = 0 whenever r is even} 


If s =(z,) € X then 


lz + Yl] = inf sup {li — snl, foal, los — yaly- +++ op byar-al < 00} 
= sup |z2,| 
T 
= ||z — y|l where y = (21,0, 23,0,25,0,...) 


and the infimum is attained a some y € Y. This y is not necessarily unique. In fact if 
lly'lloo S sup, |v2-| then ||z — y — y'loo = lly — y'lloo- 


If J : X/Y — &@ is defined as in Example 1.4.3 then J is again an isometric 
isomorphism. 


Exercise 1.4.5 Let X = B™[0,1] the vector space of bounded real-valued functions 
on [0,1] with the supremum norm and let Y = C[0,1]. Show that. if ¢ = ljo1/. then 
lc + Y || = 1/2 yet there is no y € Y with ||z — yl]. = 1/2. 


1.5 Dual Spaces 


One description of functional analysis is ‘analysis using linear functionals’. Most such 
analysis is done with continuous linear functionals. In Section 2.2. on the Hahn-Banach 
Theorem we show that there are sufficiently many continuous linear functionals on a 
normed vector to carry out such analysis. 


In this section we introduce some of their properties and describe them for for 
particular normed vector spaces. 


Definition 1.5.1 
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A linear functional on a vector space V over F is a linear map f : V > F 
The algebraic dual V’ of V is the vector space of all linear functionals on V. 
Exercises 1.5.2 


(i) Show that the set of linear functional on V is a vector space for the natural rules of 
addition and scalar multiplication. 


(ii) Let (X, ||- |]1) be a finite dimensional normed vector space. If f € X’ show that f 
is continuous. 


Not all linear functionals are continuous 


Example 1.5.3 


Let (£00, || - ||1) be the subspace of ¢'(R) of sequences x = (x;) which are eventually 
zero. The formula 


f(2)= So kx, whenever x = (zz) E fo9 
1 


defines f € (£00)’. 


But f is not continuous. If c™ € has 2”) = 16% then ||c™||, = + — 0 yet 
f(z) =1 for all n. 


A linear functional is continuous if and only if it is bounded. 


Theorem 1.5.4 Let f be a linear functional on a normed vector space (X,||-||). Then 
f ts continuous of and only if there exists a constant c such that |f(x)| < ellx|| for all 
rex, 


Proof. If f is continuous it is continuous at 0. Therefore there exists 6 > 0 such that 
|f(x)| < 1 whenever ||zx|| < 26. For each z € X with x £0 


ox 
lle 
Conversely suppose such a constant c exists. If e > 0 then 


f(z) — FW) = Ife — y)I Selle — yl] <€ whenever ||x — y|| < €/c 


and f is continuous. ™ 


1 
< 26 => <1 and f(x) < Fall = ¢|lz||. 


oe 
lle 


Definition 1.5.5 


Let (X, || - ||) be a normed vector space. A linear functional f € X’ is bounded if 
there exists a constant c < oo such that |f(z)| < cl|z|| whenever x € X. 
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If f is bounded its restriction to the closed unit ball of X is continuous. The norm 
of f is is the supremum norm of this restriction: 


fll = fll = suptlf(@)1: [lel] S$ 1} = sup{lF()| : llel] = 13 (1.5) 


The dual space X* of (X, ||-||) is the vector space of all bounded linear functionals 
on X. 


Lemma 1.5.6 If f € X* then ||f|] =inf{c: |f(x)| <ellz|] for all a € X}. 


Theorem 1.5.7 Let f be a linear functional on a normed vector space (X,||-||). Then 
f is bounded tf and only tf ker(f) is a closed subspace of X. 


Proof. Assume f # 0. If f is bounded then f is continuous. If (z,) C ker(f) and 
lim, z, =z € X then lim, f(z,) = f(z) = 0 and z € ker(f). Therefore ker(f) is closed. 


If ker(f) is closed then H = f~*(1) is a non-empty closed affine hyperplane in X. 
Therefore there exists € > 0 such that {x € X : ||z|| < e} NH = 9. It follows that ||z|| > € 


whenever |f(x)| = 1. Therefore ||x/|f(x)||] > ¢ whenever f(x) # 0 and |lz|] > e|f(x)|. 
Therefore f is bounded. m 


Lemma 1.5.8 Let (X,||- ||) be @ normed vector space. Then X* with norm given by 


(1.5) and addition and scalar multiplication 


(f + 9)(2) = f(x) + 9(2), OAF)(e) =Af(z)  wheneverz EX, fygeX* (1.6) 


18 a@ Banach space. 


Proof. If f € X* and 0 <c ER with |f(z)| < e||z|| for all c € X then |f(z/|lz]|)| <¢ 
and ||f|| < ¢ < oo. Moreover |f(x)| < ||f|l||z]] for all c € X. 


If f,g € X* then (1.6) defines f +g € X’. Forallx EX 


IF + 9)(@)I = lo(z) + F()| < lg(@) + lo(@)] < IF Ile + Illi 
It follows that f + g € X* and ||f + 9|| < ||FI| + llgll- 


Similarly ||\f|| = [A||| fl] and || f|] = 0 if and only if f = 0. This shows that (X™*, ||-|]) 


is a normed vector space. 


To prove that X* is complete consider a Cauchy sequence (fr) C X*. If e > 0 there 
exists N = N, € N such thatThen 


[fn(z) — fm(z)| < Wfn — fmilllz|] <ellz|] whenever x € X. (1.7) 


Therefore (f,(z)) is Cauchy sequence of scalars which converges to a limit f(x) for each 
x eX. Now 


fle +y) =lim f,(w + y) = lim( fax) + faly)) = Fe) + FW) 


f(Ar) = lim f, (Ar) = Alim f,(@) = Af(z) 
whenever z,y € X and \ € F. Therefore f € X’. 
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Letting m — oo in (1.7) gives that |f,(z) — f(x)| < e|lz|| whenever n > N and 
« € X. It follows that fy — f € X* so that f € X*. Also || f, — f|| < € whenever n > N 
and the Cauchy sequence (f,) converges to f € X*. Therefore X* is a Banach space. # 
Definition 1.5.9 


A subset S' of a metric space X is dense in X if X = S the closure of S. 


Exercise 1.5.10 


If T is dense in S and S is dense in X then T is dense in X. 


Examples 1.5.11 
(i) £o9 the vector space of finite sequences with values in F is dense in co, @! and £. 
For « = (z,) € put 2™ = (21,22,-..,2y,0,0,...). Then 2™ € 9 and if e>0 
then there exists N = N, € N such that |J2 — 2™||, = °% |x,,| < e. The other cases are 
similar. 
(ii) £o0 is not dense in £°. 
Let «= (1,1,...,1,...) € £° then || — x||.. > 1 for all xz € &go. 
(iii) L°*°?(R) is dense in L,(R) and L?(R). 


This will be shown in Examples 2.1.4. 


(iv) L**°?(R) is not dense in L®(R). 


Since ||1 — lo. > 1 for all ¢ € L*?(R). 


(v) The vector space Coo of continuous functions f : R + F which are zero outside some 
bounded set supp(f) (the support of f) is dense in L;(R) and L?(R) but not in L°(R). 


(vi) L**?(a, 6) is dense in L,(a, b), L*(a,b) but not in L©(a, b) for alla < bER. 
(vii) C[a, b] is dense in L,(a, b), L?(a,b) but not in D(a, 6) for alla <bER. 


(vi) The polynomials are dense in Ca, 6] for alla << BER. 


aL 


This is the Weierstrass approximation theorem; Theorem 4.1.24. 


Exercise 1.5.12 Finals ’90 Q5. 


Proposition 1.5.13 Let fo be a continuous linear functional defined on a dense sub- 
space L of a normed linear space X. Then there exists a unique f € X* with Fic = fo: 
Moreover ||f|| = || foll. 


Proof. If {x,} is a Cauchy sequence in L converging to « € X then 
|fo(tn) — fo(tm)| < IFIl [len — tml 


for all m,n EN, and {fo(r,)} is a Cauchy sequence of scalars. Suppose {x/ } is another 
Cauchy sequence also convergent to x. Then |fo(t,) — fo(z,)| < |lfoll ||zn — 2/,|| > 0 as 
n — oo and limy_.o fo(tn) = limy_+o fo(z',). 


Define f(z) = limp fo(zn). Then by the above remarks f is well defined. It is an 
easy exercise to show that f is linear and that fir = fo. Now 


|f(z)| = lim | fo(zn)| < |] foll im |]22|] = || fol lle), 
and f is bounded with ||f|| < || fol]. But 
fll = sup{|f() : [lel] = 1} 2 sup{|fo(x)| : 2 € L, |x|] = 1} = |[foll, 


and ||f{| = || fol]. Since any continuous extension f of fo must satisfy the equation 
f(r) = limyo fo(@n) above it follows that f is unique. = 


The definitions and arguments used in this section apply to linear transformations 
(also called linear operators) T : X — Y where the normed vector space (Y,]|| - |ly) 
replaces (F, | - |). 


Definition 1.5.14 


Let (X, || - ||x) and (Y,]| - |ly) be normed vector spaces. A linear transformation 
T:X —Y is bounded if there exists a constant c < co such that 


|Z(z)|ly < ¢llz||x whenever x € X. 
If T is bounded the norm of T is 
Il = sup{IT(2)[ly = lollx <1} = supf||T(@)|ly = llellx = 1} (1.8) 
T is an isometry if ||Tz||y = ||z||x whenever z € X. 


L(X,Y) is the vector space of bounded linear transformations T: X — Y. IfY =X 
then L(X) = L(X, X). 


Lemma 1.5.15 [fT € L(X,Y) then ||T|| = inf{c: ||Tz]ly < ||z||x for all z € X}. 
Lemma 1.5.16 If S,T € L(X) then ||ST|| < ||S|| ||T]- 
Proof. ||$(¢/lal)|| < [ISI] for all « #0. Therefore then ||$Ta|] < [|S [zl| < (SII 


whenever ||z|| = 1. 


Exercises 1.5.17 


Ze 


Prove the following. 
(i) A linear transformation T : X — Y is continuous if and only if T is bounded. 
(ii) L(X,Y) with operator norm given by (1.8) and addition and scalar multiplication 
(T + S)(x) = T(x) + S(x), (AT)(x) =AT(®) whenever x € X and S,T € L(X,Y) 
is a Banach space. 


(iii) Suppose Y is a Banach space. Let Xo be a dense subspace of X and let Ty : Xp ~ Y 
be a bounded linear transformation. Then there exists a unique linear transformation 


T:X —Y with T)x, = To and ||T|| = ||Toll. 


Exercise 1.5.18 Finals ’89, Q1. 


Example 1.5.19 cj is isometrically isomorphic to 2. 


Define J : £1 > c} by 


(Jy)(x) = ak for t = (tn) Eco, y=(yn) EL. 


n=1 
We show 
(i) 2 anYn is convergent, 
(ii) Jy € 6G, 


(iii) Jy is bounded and lly ll < |lylla, 
(iv) J: 2 — cf is linear, 
(v) ll Tyla > |lyll1, which implies J is injective, 


(vi) J is surjective. 
(3) 
Zyl S do lynllenl S sup len] 7 lym! = flelloollyl: for all y € £1, @ € co. 


(ii) and (iii) (1.8) implies that Jy is a bounded linear functional on ¢y with ll Tulle < Ulylls 
for all y € 2. 


(iv) Suppose a,a’ € F and y,y’ € #. 


J(ay +a'y')(z) = S(@Yntn +a'y's')=a » YnEn + a’ Soy'2' = a(Jy)(z) + a’ J(y’)(z) 


for all z € cp. Therefore J is linear. 
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(v) Ife >0 and y € @’ there exists N = N. € N such that Dn l¥nl <€. Forn<N 
let z, € F with ||z,|| = 1 be such that z,y, = |yn| and let x, = 0 forn > N. Then 
« = (z,) € cp with ||z|]| = 1 and 


\Ju(2)| = Jute) = 5 bval > Ile 
Therefore ||Jy|| > |ly||- 
(vi) Define ce) = (e)) € cp by e) = 6. If f E cp then let y; = f(e). Let a; € F 
with |a;| = 1 and a;y; = 1 and put 2™ = SP a;e. Then ||c™||,, = 1 and 
Yul =F) <Mllg lle for all and ye & 
If v € cp let vO = 4 v;e9), Then 


FV) = Srv;y5 = Ily)(v™). 


If e > 0 then there exists N = N, such that sup, sy |val = {lv —v™I|., < €. It follows 
that ~ 


Le) — (Suy(v)| = Fe =») = (Tuy — >| < eit lhg + elle 
and f(v) = (Jy)(v) for all v € cg and J is surjective. 
Example 1.5.20 (é')* is isometrically isomorphic to £©. 
Define J : £° — (£')* by 


(Jy)(t) = >> try, whenever z € £1, y € L*. 


n=1 
We proceed as in Example 1.5.19 to check (i)-(vi). 
(i) 


fo.<] 


TnYn 
1 


I(Jy)(z)| = = > Fao S Ihylloo Do en] = [lylloolllhs. 


Therefore >>, 2nYn 1s absolutely convergent. 


n= 


(ii),(iv) Linearity follows as in Example 1.5.19. 


(iii) Since |(Jy)()| < [lyloollalt. 
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(v) [yal = (Fue) S IF ulleyellelh = [Tull (aye for all n € N. Therefore 


lIylloo = sup lyn] S [|Full cay*- 


(vi) If f € (€')* then put y, = f(e). Then |yn| < IF lly le Ils = || fll ayx for all 
n and y = (yn) € €°. Iv € let vO = vje%), Then 


(OES uy =e. 


If « > 0 then there exists N = N, such that 4, |yal = |lv = Vv], < « If yO) = 
yt pe then ||v — UV), <e. Then 


lf) — (Jy) = [Fe — ¥) — (Jy — YO) < ell fllaye + ll Tull aye 
and f(v) = (Jy)(v) for all v € @' and J is surjective. 
Example 1.5.21 ¢?(R)* is isometrically isomorphic to ¢(R)?. 


This is a general property of Hilbert spaces and follows from Corollary 3.3.8. In 
the complex case Corollary 3.3.8 gives a conjugate-linear isometric isomorphism be- 
tween £2(C)* and £°(C) which composed with the map (z,) — (&,) gives an isometric 
isomorphism. 


Other examples of dual spaces are 

(FM hd =F" I theo) 

(FP, |] + Hloo)* © CF", [I - Ihe); 

- CF [I -la)* = (F*, Ul + lle); 

. L?(a,b) = L*(a,b) whenever —c0 <a <b < oo. 
. L'(a,b) = L©(a,b) whenever —oo < a < b < co. 


ao oO fF WOW HY 


. C[a, b]* is the vector space of Radon measures on [a, }] 


7. (€°)* is the vector space of Radon measures on a very large compact space; the 
Stone—Cech compactification of N. 


In cases 1-3 the isomorphism is given by (Jy)(z) = DU} cy, and in cases 4 and 5 by 
(J9)(f) = Se f(2) f(x) dx. 


Exercises 1.5.22 (i) Prove the dualities 1,2,3 above. 
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(ii) Let c be the subspace of £© consisting of convergent sequences. Redefine £! to be 
the vector space of sequences y = (y,,)°29 with |ly|l1 = [229 lyn|. Show that the formula 


(Jy)(z) = EAE + Yo jim. By for y€ ll andz€ec, 
1 


defines an isometric isomorphism J from ¢! onto c*. 
Exercise 1.5.23 Finals 89, Q5, 90, Q4, 91, Q2. 


If (X, || - ||) is a normed vector space the second dual of X is X** = (X*)*. If 
x € X then the formula 


TOS y= 7 Ce) whenever f € X*. (1.9) 


defines r(x) € X**. The Hahn~Banach may be used to show that ||r(x)|| = ||a|]. In fact 
7: X — X** is a linear isometry onto a subspace 7(X) of X**. If 7(X) = = X** then X 
is said to be reflexive. All finite dimensional normed vector spaces are reflexive. The 
Hilbert spaces ¢? and L? are reflexive. All Hilbert spaces are reflexive. 


If X = cg which is a subspace of X** = £° then 7 is the identiy map. In This case 
7(X) # X** and co is not reflexive. Nor are ¢', £°, L1, L®, C[0, 1]. 


Definition 1.5.24 


Suppose (X, ||- ||) is a normed vector space and r : X — 7(X) is an isometry from X 
onto a dense subspace 7(X) of a Banach space (X, ||-|f) then (X, ||-|[) is a completion 
of (X, || - |]). All completions of (X, || - |]) are isometrically isomorphic. 


The isometry 7 may be used to construct a completion of X. Since X** is complete 
the closure 7(X) of r(X) in X** is complete by Corollary 1.2.10. Therefore X is 
isometrically isomorphic to a dense subspace of the Banach space T(X) which is a 
completion of X. 
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Chapter 2 
The Hahn-Banach Theorem 


2.1 Separability 


Although in general functional analysis we try to put no restriction on the infinite 
dimension of our vector spaces, it is often much easier to work with separable spaces 
where the familiar induction arguments often apply. Otherwise another axiom such as 
the Axiom of Choice, Zorn’s Lemma, or the Axiom of Transfinite Induction has to be 
introduced. 


Definition 2.1.1 


A metric space, and in particular a normed linear space, is separable if it has a 
countable dense subset. 


Definition 2.1.2 


The Q-linear span of a subset S of a real or complex vector space is the set QIs[S] 
of finite linear combinations }°f a,z, of elements 2, € S with coefficients a, which lie 
in Q if X is real and Q +72Q if X is complex. 


Lemma 2.1.3 (i) The Q-linear span of a countable set is countable. 


(11) If S and T are subsets of a normed vector space X with S dense in T then the 
Q-linear span of S is dense in the linear span of T. 


Proof. (i) Let S = {x,}f29 be a countable subset of X. Suppose that X is real and 
define ¢, : Q” > Qls[z1,...,2,] by the formula 


bn(Q15--+5 In) = SRT (91,--+54n) c Q”. 

k=1 
Then ¢, is onto and Q” is countable so that QIs[z,,...,2,] is countable for all n. Now 
Qls[S] is a countable union — US, QIs[z,,...,2,] — of countable sets, and is therefore 


countable. The complex case is similar. 
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(ii) If a1,...,2, € T and ay,...,a, € C then let 
M = max{||z1|l,.--, ||znll, lal, ---, |anll}- 


Let € > 0 and choose g; € Q +2Q such that |a; — q;| < €/4Mn and y; € S such that 
lz; — y;|| < €/4Mn. Then 
|| do wei — D0 aivill < DO(le(ai — vs) || + IG — a2) y;||) < € a 


Examples 2.1.4 


(i) Every finite dimensional normed vector space X over R or C is separable. 


X is the linear span of a finite basis S$. By Lemma 2.1.3 with T = S the countable set 
QlIs[S] is dense in X. 


(ii) co, €', & are separable, [K. 1.3-10]. 

For each of these sequence spaces let S be the set of sequences with entries in Q+iQ 
and with only finitely many entries non-zero. Then S is a countable dense subset. 
(iii) L*©? is a separable subspace of both L1 and L?. 

Let S = {lpq : Pp <4 € Q} and let T = {1,,4): a < bE R}. Then S is countable 
and Is[T] = L***? as a subspace of L’ or L* (the elements of L! and L? are equivalence 


classes of functions agreeing almost everywhere). If a < 6 € R and ec > 0 then there 
exist p < q € Q with |a — pl, |b —q| < «. Then 


[Mem — Tpal = [Cres — lp)” < 2¢. 


Therefore S is dense in T for both the L}- and L?-norm. By Lemma 2.1.3 QIs[3S] is 
countable and dense in [s[T] = L**°? for both norms. 


(iv) L' is separable. 
If f © L'™ then there exists ¢ € L**? with ¢ < f and 
[(f-9)= [\f-dl=lf -dll<e 
Therefore L* is dense in L'*°. It follows from the triangle inequality that L*? is 


dense in L'** — L'** = L!. It follows from Exercise 1.5.10 and (iii) that the countable 
set QIs[5S] is dense in L’. 


(v) L*={f : f is measurable and f? € L*} is separable. 
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Recall that L? = {f : f € L'[-n,n] for alln EN, and f? € L'}. Suppose fer 
and for n € N put fr = lt-an»ymid(—n, f,n). Then f,(c)? < f(z)f,(z) and therefore 
(f(z) — fr(x))? < f(x)’ — fr(x)? whenever « € R. Now f, € L* and the sequence f? 
is monotone increasing to f?. By the monotone convergence theorem given € > 0 there 
exists n = n, such that 


If- fll = [(f-fP < [(P-R)< 2. (2.1) 
Now f, € L* so there exists ¢ € L*? such that f|f, — 4| < €?/2n. By replacing ¢ 


by mid(—n, 4,7) if necessary, it may be assumed that —n < ¢ < n and that (x) = 0 
whenever |x| > n. Therefore 


lf - 98 = [If 9P < J \f- 41 (fal +16) < [ lfn — ¢|2n < e”. 


Therefore ||f — ¢||2 < 2e and L**? is dense in L?. Arguing as in (iv) the countable set 
QIs[S] is dense in L?. 


(vi) [°° is non-separable, [Kreysig. 1.3-9]. 


The set T' of non-terminating sequences 7 of Os and 1s is uncountable since every 
point in (0,1) has a unique dyadic(base two) decimal expansion which gives rise to such 
a sequence. Distinct sequences are at a distance 1 or 2 from each other in ©. If $ is 
dense in £” then for each 7 € T there exists s, € S with ||s, —7]] < 1/2. The s, must 
be distinct and therefore uncountable. 


Exercises 2.1.5 


(i) Let X be a normed linear space. Suppose that X has a sequence of separable 
subspaces {X, : € N} such that Uf?X, is dense in X. Then X is separable. 


(ii) C[0,1] the continuous functions on [0,1] is separable, but C,(0,1) the bounded 
continuous functions on (0,1) is non-separable for the supremum norm. 


(iii) L*°? is non-separable for the supremum norm. 


Exercise 2.1.6 Finals ’90, Q1. 


Lemma 2.1.7 A real or complex linear space is separable if and only tf it has a count- 
able subset K whose linear span (s/[K] is dense in X. 


Proof. Consider the real case. The linear span over the rationals QIs[K] is dense in 
[s[I<] and is countable. It follows that the condition is sufficient. Necessity is obvious.™ 
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2.2. The Hahn-Banach theorem and Corollaries 


The Hahn-Banach theorem is the most important theorem in functional analysis. Func- 
tional analysis could be described as ” analysis using linear functionals”, and the Hahn- 
Banach theorem is an existence theorem guaranteeing enough functionals to do this 
analysis. 


Recall Definition 1.5.5, that a linear functional f on a normed linear space X is 


bounded if the norm of f: ||fllx = ||f|| = sup{|f(z)| : « © X and ||z|| = 1} < o. 


This is true if and only if f is continuous. 


Let (X,|| - ||) be a three-dimensional normed vector space and let f € X* with 
\|f|| = 1. Since the closed unit ball B of X is compact there exists « € X with ||z|| =1 


and f(x) = 1 = sup{|f(y)| : |lyl| < 1}. Therefore H = me) is a plane which touches 
B at X. Conversely if H is such a plane there exists a unique f E X* with |/f|| = 1 
and ‘H = f—1(1). 


Now let Xo be a two-dimensional subspace of X and let fo € X¢ with || fol] = 1. 
Then the line Hyp = fo '(1) touches the unit ball BO Xp of Xo at some point x9 with 
||zo|] = 1. Since B is convex it is geometrically intuitive that Ho lies in a plane H 
tangent to B at zo. By the above remarks there exists a unique f € X* with ||f|] = 1 
and H = f~'(1). Moreover fx, = fo. This is a special case of the following theorem. 


Theorem 2.2.1 (Hahn-Banach Theorem for separable real spaces) Let fo be 
a continuous linear functional on a subspace Lo of a separable real normed vector space. 
There exists a bounded linear functional f on X such that fiz = fo and ||f\lx = || follz- 


Remark. This theorem remains true for non-separable complex vector spaces, but the 
proof which requires the axiom of choice is outside the syllabus. 


Proof. Suppose without loss of generality that || fol] = 1. 


(a) One-step extension. If s; € X — Lp and c € R then fo may be extended to f; on 
me Is[Lo, 31], the linear span of Lo and s;, by the formula 


fil + as1) = fo(z) + ac, a eR. 


Of course this extension of fg does not necessarily preserve the norm. The problem is 
to find c such that || f,|] = 1. Such a c must satisfy 


[A(z + 81) = |fo(z) + €] < |e + sill x € Lo. | (2.2) 


This implies that 


—|lzt+sll<folc)+e, foly)te<lly+sil zyely (23) 
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Equivalently c must satisfy 


— ||z + s1]| — fo(x) < ¢ < |ly + s1]] — foly) whenever x,y € Ly. (2.4) 
Now 
foly — 2) S lI(y + 81) — (@ + 81)]] S lly + sal] + [lz + 54] whenever z,y € Lo. 
7 Therefore 
—||z + s1|| — fo(x) < ly + sl] — fo(y) for all z,y € Lo, 
and 


sup {—||¢ + s1|| — fo(z)} = a < co = inf {Illy + 51|] — fo(y)}. 
xELo yELo 


Choose c € [c1,¢2]. Then c satisfies (2.4) and (2.3), and f; satisfies (2.2). If x € Ly and 
a € R then 


x z ie 
[file + asi )] = Jal LAC + s1)I = lal |fo(=) + e| S feel I= + sal] = lle + asi | 
and || f;|| < 1. Since || fol] = 1 and f, is an extension of fo it follows that || f,|| = 1. 


(b) Induction If S = {s, : n € N} is a dense subset of X then fy may be extended 
without change of norm to the linear span L,, = Is[Lo, S] as follows. Suppose inductively 
that f, 1s a norm-preserving extension of fo to L, the linear span Is[Zo, s1,...,8n]. If 
Sn4i1 & L, then by (a) f, has a norm-preserving extension fri: to Lng. If Sng, € Ln 
then put fr41 = fr. Now define the linear functional f,, on L,, as follows. If x € Lo, 
then x € L, for some n. Put f..(x) = f,(z). Then f,. is well defined since if « € Ly 
for some m > n then fn(z) = fn(z). Moreover || foo|] = 1 since | foo(x)| = |fn(x)| < |lz||- | 


(c) Now L.. is dense in X so by Proposition 1.5.13 the functional f,, has a unique | 
norm-preserving extension f to X.— 


“Exercise 2.2.2 Finals ’88, Q2, 90, Q3. 


The Hahn-Banach theorem guarantees the existence of many bounded linear func- 
tionals. Recall that if f € X*, the dual space of X, then ||f|| = sup{f(z) : ||z|] = 1}. In 
fact for each unit vector « € X there exists f € X* which attains its absolute maximum 
at 2. 


Corollary 2.2.3 If X 13 a separable real normed vector space and ty € X with 
|zo|| = 1 then there exists f © X* such that 


F(%o) = fll = [lol] = 1 


Proof. The formula fo(azq) = a defines a linear functional fo on Lo = Is[z9] such that 
| follzo = fo(vo) = 1. By Theorem 2.2.1 fo has a norm-preserving extension f € X*.- 
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Corollary 2.2.4 If ¢€X and f(x) =0 for all f € X* thenz =0. 


We can now show that the natural embedding r : X + X** defined by (1.9) is an 
isometry. 


Corollary 2.2.5 [fx eX then 
llz|| = sup{lg(z)]: 9 € X*, [gl] = 1, (2.5) 
It follows that the natural embedding tr : X — X** is an isometry. 


Proof. Let zo = x/||x|| and choose f as in Corollary 2.2.3. For g € X* with ||g|| = 1 we 
have |{g|| = sup{|g(z)| : ||z|] = 1}. Therefore g(x) < ||x|| whenever x € X and 


sup{|9(z)| = [lgll = 1} < [zl = f(x) < sup{l9(z)|: Ilgll = 
proving (2.5). Now . 
II7(2)Il = sup {Ir(z)(g)I = Ilgll = 1} = sup{lg(z)| : Ilgl] = 1} = lel. 
and 7 is an isometry. ™ 
The annihilator of a subset S$ of X is 
S° = {6 € X*: bs = 0} 


Corollary 2.2.6 Let SC X and let Y be the linear span of S. Then Y is dense in X 
if and only S° = {0}. 


Proof. If Y is dense in X and ¢ € S° = L° it follows from Proposition 1.5.13 that ¢ = 0. 


-If the closure Y # X then there exists 2; € X —Y. Let Y, be the linear span of Y 
and y, and define ¢, € Y;* by 


dily tay) =a whenever y € Y anda €F.: 


Then ker(¢,) = Y is closed in Y, so ¢, is bounded by Theorem 1.5.7. By the Hahn- 
Banach Theorem ¢, has a norm-preserving extension ¢ € X*. Therefore 0 # ¢ € S° 
and S° # {0}. m 


The following corollary gives another formula for the norm of a quotient space. 


Corollary 2.2.7 If Y 1s a closed subspace of X and x € X the distance from z to Y 
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d(z,Y) = lle + Y|| = inf{||z — coll : x € Y} = sup{|d(x)|: de Y°, lol] =1}. (2-6) 
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Proof. lf ¢ € Y° with |/¢|| = 1 and 2 € X then 
o(x) = d(x — x) < ||z — zol| whenever 2 € Y, 
and $(x) < inf{||e — xol| : 29 € Y} = d(e,Y). therefore 
sup{If(2)|:¢€Y°, [sl] =1} <d(2,¥). 


By Corollary 2.2.3 there exists h € (X/Y)* such that ||A|| = 1 and h(x +Y) = |l2 +Y]]. 
If y € Y then define ¢(y) = h(x + Y). Then |4(y)| < lly + Y|] < |ly|] and ¢ € X* with 
|¢|| < 1. In fact 6 € Y°. Therefore 


d(x,Y) = 6(x) < Me) 2 d(x,Y) 


Ill 
giving equality in (2.6). m 


There is a geometric way of looking at Theorem 2.2.1. If f € X* then ker(f) is a 
closed subspace of X of codimension 1. Then f~1(1) is a translation of this subspace 
namely a closed affine hyperplane H, which separates X into two disjoint open half- 
spaces, whose closures intersect in H. 


Corollary 2.2.8 If xo € X with ||xo|| = 1 then there exists a closed affine hyperplane 
Ho containing 2 and such that the closed unit ball of X lies within one of the closed 
half-spaces determined by Ho. 


Remarks. (a) The hyperplane Ho is tangent to the unit ball at zo. 
(b) This shows that the unit ball in X is the intersection of closed half-spaces. 


The example 2.1.4, X = I’, X* = I”, shows that X separable does not imply 
that X* is separable. However, the Hahn-Banach theorem may be used to prove the 
converse. 


‘Theorem 2.2.9 If the normed linear space X has a separable dual space X* then X 
1s separable. 


Proof. Choose a countable dense subset {f, :n € N} of the unit sphere {f : ||f|] = 1} 
in X*. Since ||f|| = sup{f(z) : x € X, ||z|] = 1} there exists a sequence S$ = {zp : 
lz, |] = 1} C X with f,(z,) > 1/2 for alln € N. Then L = Is[z, :n EN] the closed 
linear span of S is separable by Lemma 2.1.7. If L # X then by Corollary 2.2.8 there 
exists f € X* such that fi, = 0 and ||f|| = 1. Then || f — fn|| < 1/4 for some m and we 
obtain the contradiction 


1/2 < |fm(@m)| = I(f — fm)(%m)l] < IF — frllllem|| < 1/4. 


Theorem 2.2.10 A normed vector space (X,||- ||) 1s finite dimensional if and only if 
the closed unit ball 1s compact. 
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Proof. Necessity was proved in Corollary 1.2.16. Suppose X is infinite dimensional. 
We construct a sequence (e,) in x such that |le,|| = 1 and |len — em|| > 1. Suppose 
€1,..., x have been so chosen, and let Ly = Is[e,...,e,]. Choose y € X — Ly and and 
let Liy1 = Us[Ly,y]. Define f € Lf, by 


f(t+ay)=a for € I, anda eéF. 


Since the closed unit sphere in L,4, is compact there exists e,41 € Ly41 such that 
llex4a|] = 1 and |f(ex41)| = ||f||. Then 


[Fl = [Flees )1 = Fler — 2)| < ll llex+1 — =| whenever z € Ly, 


and |le,41 — e;|| = 1 whenever j = 1,2,...,k. The bounded sequence (e,)°2, has no 
convergent subsequence so the closed unit ball is not compact. m 


Exercise 2.2.11 Finals ’88, Q6. 


We give a final application of the Hahn-Banach theorem. 


Definition 2.2.12 


As in the finite dimensional case if X and Y are normed linear spaces and T € L(X,Y) 
then the formula 


T*(g)(x) = g(T2) g€Y*, 2 EX, 


defines a linear operator T* called the dual of T. Kreyszig uses the notation T’ to 
distinguish the dual of T from the Hilbert space adjoint of T. 


Theorem 2.2.13 If X and Y are normed linear spaces and T € L(X,Y) then T* € 
L(X*, ¥*) and ||T*|| = ||7\. 


Proof. If g € Y* then 
I9(Te)| < Hgll Pell < lol ITH Mell (2.7) 
and z — g(Tz) is a bounded linear functional on X denoted T*(g). From (2.7) 


IZ*(9)ll = stp Ge) = cup tla) I} < aap tll [Tz ]} = IglH TI. 


Therefore T* is bounded and ||T*|| < |]T\]. 


If x € X with ||z|| = 1 then by Corollary 2.2.3 there exists g € Y* such that 
(Tx) =|\al| and |p|] = 1. ‘Then 


||Tz|| = g(P2) =T*(g)(x) < |IT*(9)I < IIT" I. 


Taking the supremum over ||x|| = 1 gives that ||T'|| < ||T*]]. = 
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Exercise 2.2.14 Finals 91, Q3. 

The proof of the Hahn-Banach theorem requires only the of subadditivity and posi- 
tive homogeneity properties of the norm. 
Definition 2.2.15 


A sublinear functional on a real vector space X is a functional p: X — R such that 
p is subadditive:- 


p(x +y) < p(z) + ply) whenever z,y € X. 
And p is positive homogeneous:- 
p(axr) = ap(z) whenever 0< @ER, cE X. 


The functional p(x) = ||x|| on a normed linear space is sublinear. The proof of the 
following theorem, in which separability is not assumed, requires axiom of choice and is 
outside the syllabus. 


Theorem 2.2.16 (Hahn-Banach Theorem with sublinear functional) Let p be 
a sublinear functional on a real vector space X and suppose that fo is a linear functional 
on a subspace L of X such that 


fo(z) < p(z) whenever x € L. 
Then there exists a linear functional f on X such that fi, = fo and 


f < p(s) whenever x € X. 
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Chapter 3 


Hilbert Space 


3.1 Inner Product Spaces 


Hilbert space is the richest Banach space. Infinite dimensional Hilbert spaces still retain 
most of the properties of Euclidian space, such as Euclidian distance, orthogonality etc. 
We recall a definition from linear algebra. 


Definition 3.1.1 (Inner product) 


Let X be a vector space over a field F which may be either R or C. An inner product 
on X is a mapping (-,-): X x X —F such that for all z,y,z € X and alla EF 


(x +y,z) = (2,2) + (y,z) (3.1) 
(az, y) = a(x, y) (3.2) 

(x,y) = (y,2) (3.3) 
(z,2) >0 and (2,2) =0@2=0. (3.4) 


Exercise 3.1.2 
Ifz e€ X then z =0 © (x,y) =0 for ally € X. 
We show below that an inner product defines a norm on X via the formula 
ell = Ve, 2) (3.5) 
Note. An inner product is linear in the first variable and conjugate linear in the second. 


We now come to the most important inequality in analysis. 
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. if roe 


Theorem 3.1.3 (Cauchy-Schwarz Inequality) Let X be a vector space with inner 
product (-,-). If x,y EX then 


K(z,9)1 S Hlellllyll (3.6) 


where ||z|| = \/(x, 2). 


Equality holds in (3.6) if and only x an y are linearly dependent. 


Proof. Suppose « # 0. Choose @ € [0,2m) such that e’ (x,y) = |(z,y)|. Ifr € R then 


6 i68 16 


r—y)= r(e rier) — rea, y) —r{y, ex) + (y, y) 
= |Jx||? — 2r|(z,y)| +r? |lyl’. 


This quadratic in r has at most one real root, so that |(x, y)|? — ||z||?||y||? < 0. 


0< lre?x oe yl? = (reexr — y,re 


Equality holds in (3.6) if and only if the discriminant is zero. This is the case if and 
only if the quadratic r — ||re*®x — y|| has exactly one zero ro which is true if and only 
i 

z= yl 


Corollary 3.1.4 [fx € X then 


IIzll = sup{l(z,y)| = y € X and [lyl| = 1} 
Proof. If |ly|| = 1 then |(z,y)| < ||x||. If y = x/||z|| then (z, y) = ||z||.m 


Corollary 3.1.5 The functional x > ||z|| ts @ norm on X. 


Proof. It follows from (3.4) that « = 0 if and only if |z|| = 0. 


If a € F then |laz|| = ,/(az, az) = ,/a&(z, x) = |a|||z|| whenever x € X. 


If c,y € X then (z,y) + (y,z) = 2Re(z,y) < 2|(z,y)|. By the Cauchy—Schwarz 
Inequality (3.6) 


lle + yl? = (2 +y,0 +) = [lel + (2, y) + (y,2) + lly? < lel]? + 2llelilyll + lly? 
= ([lz]] + llyll)?. = 

Theorem 3.1.6 If X is a complex inner product space and T € L(X) then T = 0 if 
and only if 

(Ea, 2) =0 whenever x € X (3.7) 
_ Proof. Suppose (3.7) holds. For all a € C and z,y € X 

(T(az +y), (aw +y)) =lal*(Tx,2) + (Ty,y) + a(T2,y) + a(Ty, 2). 
The first three terms are zero, and, choosing a = 1 and 2, 
(Tz,y)+(Ty,2)=0 (Tz,y) — (Ty, 2) = 0. 

Therefore (Tx, y) = 0 for all z,y € X andT = 0.8 
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Definition 3.1.7 
An inner product space is a normed linear space whose norm is defined by an inner 


product. A Hilbert space is a complete inner product space. 


Examples 3.1.8 


(i) R" and C” with the dot product are Hilbert spaces called real and complex 
n-dimensional Euclidian space. 


(ii) ? is a Hilbert space. For « = {z,}, y = {yn} € @ put (x,y) = apy. Then (-,+) 
is an inner product which defines the norm on /?. 


(iii) L? is a Hilbert space. The inner product of f,g € L? is f fg. 


A linear subspace of an inner product space is an inner product space for the 
restricted inner product. 


Exercise 3.1.9 
(i) A linear subspace of a Hilbert space is a Hilbert space if and only if it is closed. 
(ii) Let X1, X2 be inner product spaces with inner products (-,-)1, (-,-)2. Let 

(1, Y1)s (25 Yo))(2) = (@1, 22)1 + (22, Yo)2 whenever z;, y; € X; 


Show that (-,-)(2) is an inner product on X, x X2 which determines the norm Il - Ica) in 
(1.1). Show further that (-, -)(2) is the unique inner product on X; x X2 whos restriction 
to X; is (-,-); for which (X, x {0}) 1 ({0} x XQ). 


This may be called the natural inner product on X, x X_ and it induces the product 


topology. 


Lemma 3.1.10 (Continuity of inner product) Let X be an inner product space, 
and let the product space X x X have the natural inner product and norm. Then the 
mapping 

(x,y) > (x,y) r,yEeXx 


from X x X to F ts continuous. 
Proof. Suppose (tn, Yn) > (z,y) in X x X. By the Cauchy-Schwarz inequality 


(nm) — (5 9)| = (ens 9m — y) + (@n — 2,9) < [len [lyn — yll + len — all lly 
which tends to zero as n — oo by continuity if the norm. m 


An inner product space may be characterised purely in terms of its norm. 
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Definition 3.1.11 (Parallelogram Law) 
A norm || - || on a vector space X satisfies the parallelogram law if for all x,y € X 
lle + yll? + [lz — yl? = (lel? + yl?) (3.8) 


Theorem 3.1.12 Let X be a normed vector space. The norm on X is defined by an 
inner product (-,-) if and only if it satisfies the parallelogram law. The inner product is 
unique and ts related to the norm in the real case by 


(cy) = Z(le +l? ll uP), 9) 


and in the complex case by 


1 i 
(e,y) = Gllle + yl? = Ile — yl?) + GClle + cyl? — [le — ty?) (3.10) 
whenever x,y € X. 


Proof. A simple calculation expanding ||x + y||? = (c+ y,2+y) etc. shows that a norm 
defined by an inner product satisfies the parallelogram law. 


Suppose the norm satisfies the parallelogram law and define the map (-,-): XxX 
F by (3.9) when F = R and by (3.10) when F = C. 


It is immediate that (x,y) = (y,c) whenever z,y € X and that (z,z) > 0 with 
equality if and only if c = 0. Moreover ||x||* = (z,z). Suppose F = R. If 2,y,z € X 
then 


1 1 
2(2,y) = 5(lle + yl? — lle — yl?) = (lle + 9 ll? + Hell? — fle — yl? — lel?) 


4 
= qllle +2 +91)? + Ile — 2+ yll? = [lz + 2 — yl)? = [lz — 2 — yl). 
(a) If z = then 
2(z,y) = (22, y). 


(b) Ifu=a+zandv=2—z then 


utv 
2 


(c) if m,n € Z then 


2{ »y) =(ut+v,y) = (u,y)+(v,y) whenever u,v,y € X 


n(—z,y) = (ma,y) = m(z,y) 


and 
(qz,y) = q(x, y) whenever g € Q and z,y € X 


and (-,-) is additive in the second variable, and by symmetry in the first. Therefore 
(3.1) is satisfied. 
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For fixed x,y € X the function ¢: R — R given by ¢(@) = (az, y) is continuous by 
continuity of the norm. ¢ agrees on BBQ with the continuous function 4(@) = a(z, y). 


Therefore ¢ = w and 
(az, y) = a(z, y) whenever z,y € X andaeER 


Therefore (-,-) is an inner product which defines the given norm. = 


Corollary 3.1.13 (von Neumann) A normed linear space is an inner product space 
if and only if every two dimensional subspace is an inner product space. 


3.2 Examples of Hilbert Space 


Theorem 3.2.1 L* is a separable Hilbert space. 


Proof. If « = {tn}, y = {yn} © @ then |rngn| < |an|? + |yn|?-so that 2,9, is 
absolutely convergent and the formula (x,y) = )> rny, defines an inner product on @?. 
Moreover ||x||? = (z, x). 


Let 2 = {2 : 2) ,---} be a Cauchy sequence in £?. Then given € > 0 there exists N. 
such that for all k EN 


k ee 
Ss |x” a f™ < > Jar”) = al™ 2 <eé whenever m,n>N. (3.11) 
wz1 t=1 


It follows that for each 7 the scalar sequence {al :n =1,2,...} is Cauchy convergent 
to 2;. Letting m — oo in (3.11) gives * |x”) — 2;|? < € for all k € N. Therefore 
Ba Jo”) — x; |? <e. Therefore c — 2 € 0? where z = {z1,22,...} and ||z —2™]| <e. 
Therefore x € 7, and 2) converges to x in £2. Thus @ is a complete inner product 
space. Separability follows from Example 2.1.4 (ii).m 


The space of complex-valued square-integrable functions on R 
L’={f : f is measurable an f? € D1}={f : f € L'[—n,n] for all n € N and f? € L’*}. 
The L*-norm of f is || f|l2 = (Jf f?)?. 
The following lemma will be used to prove L? is complete. 
Lemma 3.2.2 If u, is @ sequence in L? with Y ||un|l2 = M < co then Sun converges 
both almost everywhere and in L*-norm to a function f in L?. 


Proof. Let fa = (6 u; and let g, = SG |ui|.. Then gn,g2 are monotone increasing 
sequences and |]g,,|l2 < 2G |lusl]2 <M. Therefore 


[as neN. 


By the monotone convergence theorem there exists a non-negative function g such that 
g? € L' and g? converges to g? both a.e. and in L}-norm. Therefore g, converges a.e. 
to g and f, converges a.e. to some measurable function f with |f| < g. 
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Now f? € L’ and f? < g’ so by the dominated convergence theorem f? converges a.e. 
to f? € Li. Therefore f € L?. Now |f — fl = | ora Mi] < OS |uil = g so that 
|f — fn|? <9’. By the dominated convergence theorem 


[if-FP 0 as Nn —> 0O 


and S>u, is convergent to f in L?-norm. m 


Theorem 3.2.3 L? is a separable Hilbert space. 


Proof. lf f,g € L’ then fg is measurable and |fg| < |f|? + |g|/? € L'. It follows that 
fg and |f + g|? are in L'. Therefore L? is a vector space and it may be seen that 
(f,9) = f fg is an inner product which defines the norm on L?. 


By Lemma 3.2.2 every absolute convergent series in L? is convergent in L?. By Theorem 
1.2.9, a normed linear space X is complete if and only if every absolutely convergent 
series in X converges to a vector in X. Therefore L* is complete. m 


Definition 3.2.4 


The Hardy Space H? is the space of functions f holomorphic on the unit disc with 
Taylor expansion f(z) = }°9° a,z” about the origin such that || f||? = 79° Jan|? < oo. It 
is a Hilbert space | 


3.3 The Riesz Representation Theorem 


Definition 3.3.1 (Adjoint) 
If T € B(H) then T* € B(A) is the adjoint of T if 

(Tz, y) = (z,T*y) whenever x,y € H. 
If T = T* then T is self-adjoint. 


We shall show later that each T € B(H) has a unique adjoint. 


Definition 3.3.2 (Orthogonal projection) 


P € B(H) is a projection if P? = P and an orthogonal projection if P? = P = P*. 


Suppose « € H and z = Py € ImP. Then 
(c — Pa, z) = (x — Pa, Py) = (x — Pz, P*y) = (Px — P*z,z) =0, 


and z — Pz is orthogonal to z. Thus as in the real finite dimensional case Pz is the 
orthogonal projection onto Im(P). 
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Definition 3.3.3 (Orthogonal complement) 

If S is a subset of a Hilbert space H the orthogonal complement of S is 
St = {y€H:(z,y) =0 for all c € S} 

Exercises 3.3.4 

(a) Ife € S and y € S* then ||z + yl]? = |a||? + |ly||? 

(b) S+ is closed for all S Cc H. 

(c) $+ =(Is[s])+ = (BIS. 

(d) If S = U{S.:a@€ A} then St =({St: ae A}. 

(e) P is an orthogonal projection = I — P is an orthogonal projection. 

(f) ImP = KerP* = Ker(I — P) = Im(I — P)+ 

(g) H = KerP @ ImP = Ker(I — P) @ Im(J — P) 

(h) If P and Q are orthogonal projections then P = Q if and only if ImP = ImQ. 


Theorem 3.3.5 (Nearest Point) Let L be a closed subspace of H. If c € H there 
exists a unique point Px in L nearest to x. That is 

je — Poll = d = d(e, L) =inf{|z — yl] sy € 2} 
Moreover P(x — Px) = 0. 


Proof. Choose a sequence {y,} in L with ||x — y,|| > d, and let z, = « — y,. By 
the parallogram law 


lyn — Youll? = [en — Zmll? = 2(l]2nll? + [l2nll?) = [len + 2m? 


1 
= 2(llznll? + [l2m[l?) — 4]le — 5m + Ym II? 
S 2([l2nll? + |l2mll?) — 4d? 


which — 0 as m,n — oo. Thus {y,} is Cauchy and converges to some point y € L with 
[zc — y|| = d. Note that if ||z — y,|] = |lc7 — ym|| =d then y, = ym. This shows that y is 
unique and may be denoted Pz. 


Since ||z-Px—y|| > d = ||x-Px—O0|| whenever y € L it follows that P(x—Pz) = 0.m 


Note. We have not yet shown that P is linear. 


Exercise 3.3.6 (Convex set) 


Theorem 3.3.5 remains true if L is a closed convex set (L is convex if axr+(1l—a)y € L 
whenever z,y € L and a € [0,1)). 
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This is a powerful result with many corollaries which show how properties of finite 
dimensional inner product spaces remain true for infinite dimensional Hilbert spaces. 


Corollary 3.3.7 (Orthogonality) Jf c € H then Px is the unique vector in L such 
that z— Px € Lt. It follows that P is the unique orthogonal projection of H onto L. 


Proof. Ifye Landae€R then 
# < |[ — Pe — ay||? = lle — Pall? — aRe(z — Px, y) + oll? 
Subtracting d? and dividing by a > 0 gives 
Re(e — Px,y) < allyl), a>0. 


Therefore Re(z — Pz,y) < 0 for all y € L. By linearity (x — Pz,y) = 0 for all y € L 
and  — Pz € Lt. 


Suppose conversely that p € L with x — p € L+. Then 
je — Pall? = lle — p— (Px —p)|f? = lle — pl? + ||P2 — pl? > jx — Pell? + ||Pe — pl? 
and Px = p is unique. 
If 71,72 € A and qj, a2 € K then ay21 +a9%2—a1Pr,—a2Pr2 € E+. By uniqueness 
P(ayx1 + agr2) = a4P ry + a2P 2, 
and P is linear. 
If ¢ € H then ||x|/? = ||z — Pz + Pall? = ||z — P2||? + ||Pz||? and P is bounded. 
If z,y € H then PPx = Px and 
(Pz, y) = (Pz, Py + (I — P)y) = (Pa, Py) = (a, Py). 


Therefore P = P*, and P is an orthogonal projection. m 


Corollary 3.3.8 (Riesz representation theorem) Jf f € H* there exists a unique 
zs € H such that 
Fle) ={4a,2,7) whenever x € H. 


The map J(f) = xy is a conjugate linear isometry from H* onto H. 
Proof. Since f is continuous L = kerf is a closed subspace of H. Let P be the 


orthogonal projection onto L. Choose a € H such that f(a) = 1 and let (a@ — Pa) = z. 
Now f(z) = 1 and if z € H then f(x) = f(f(z)z) and x — f(x)z € L. Therefore 


(x — f(a)z,z)=0 and (2,z) = f(x)({z,z), whenever z € H. 


If x, = z/|l2||? then . 
Fey He 24) whenever x € H. 
It follows from (3.4) that x; is unique. 
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If f,g € H* anda, €F then 
af(x) + Bg(x) = (2, J(af + Bg)) = a(x, x7) + B(x, 24) 


= (x, aJ(f) + BJ(g)) 
for all « € H. Therefore J(af + Bg) = @J(f) + BJ(g) and J is conjugate linear. 


Now ||fl| = sup{lf()] = llell = 1} = sup{(z, 27) : ||el] = 1} = [zl], and J is an 


isometry. 
If y € H and f(x) = (x,y) whenever « € H then f € H* and y = z;. Therefore J 


is onto. m 


Exercise 3.3.9 (Convex set) 


If L is a closed convex set then Pz is the unique point in L such that (Pz—2,Px—z) < 
0 for all z € L. 7 


Corollary 3.3.10 I — P is the orthogonal projection onto the closed subspace L*. 
Proof. (I — P)* =I —P* =I—P, and (I- P?) =I ~2P 4+ P? =I —P. Therefore 
(I — P) is an orthogonal projection. By Corollary 3.3.7, if y € L then ((I— P)z,y) =0 
for all c € H. Therefore Im(I — P) c Lt. 

If y € Lt then (x,y) = ((I — P)z,y) = (2,(I — P)y) for all c € H. Therefore 
y =(I-—P)y € Im(J— P), and L+ CIm(I—P). = 
Corollary 3.3.11 If L is a subspce of H with closure L then 

bb, 


Proof. Let the sequence (z,) in L converge to z € L. By the continuity of the inner 
product 


= jim (tn, y) =4259) whenever y € L+ 
and x € (Lt)+. 


If  € H—L and Pz is the orthogonal projection onto L then Pz # x. By Corollary 
3.3.7 Px-2 EL CL+ and 


(x, — Px) = ||z — Pz||? > 0 
ands ¢([*+)+. = 
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Definition 3.3.12 A vector space X is the direct sum of two subspaces X, and Xo, 
written X = X, ® Xo, if each element of X has a unique representation 


L=I%y4+ 4X where x, € X; and rq € Xo. 
Corollary 3.3.13 (Projection Theorem) /f L is a closed subspace of H then 
H = Le@L* 
Proof. Ifx € LNL* then (z, x) = ||z||? = Oandz =0. Ifz € H thenz = Pr+(I—P)z € 
L+I+. 
tae 3.3.14 The linear span Is/[S/ of a subset S of H is dense in H if and only 
is” = {0}: 


Proof. Ifz€ S+ and |s[S] is dense in H then z € Is[S]. Choose a sequence zp, € (S') such 
that z, — z. By the continuity of the inner product 0 = (z,z,) — (z,z)?. Therefore 


z=Oand S+ = {0}. 
Conversely 
St+={0} + Is[sjt={0} and —_IsfS] = {0} 
By Corollary 3.3.13 it follows that H = 1s[S]. = 


Exercise 3.3.15 Finals ’88, Q3, ’89, Q3, ’90, Q2. 


Theorem 3.3.16 (Hilbert space adjoint) Fach T € B(H) has a unique adjoint 
T* € B(H). Moreover the map T > T* is a conjugate linear isometry of B(H) onto 
BEL): 


Proof If 2,y € H then |(T,y)| < [Tall yl) $7 || [lyl| and the formula 
f(x) = (z, Ty) for all z € H defines f € H*. Define T*y = xy Then 


(Tx, y) = (2, T*y) whenever z,y € H. 
It follows easily that T* is linear. Suppose that y € H with ||y|| = 1. Then 


|Z*y|| = sup |(z,T*y)| = sup |(T'z,y)| < sup ||Tz]| = ||T]. 
Ijo||=1 {lo|[=1 fol] = 


Therefore T* is bounded and ||T*|| < ||T'||. It follows that (T*)* = T and that ||T*|| = 
|||. It may easily be verified that T — T* is a conjugate linear isometry. m 


Exercise 3.3.17 


Show that T* = JT’J—! where T’ € B(H*) is the dual of T. 
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3.4 Orthonormal sequences 
Definition 3.4.1 (Complete Orthonormal Sets and Sequences) 


Let H be a Hilbert space, not necessarily separable. A subset S of H is orthogonal 
if (c, y) = 0 whenever z,y € S and z # y. If all the elements of S have norm 1 (unit 
vectors) then S is orthonormal. If, in addition, they span a dense subspace of H then 
S is a complete orthonormal set. If S is a sequence then the terms orthonormal 
sequence and complete orthonormal sequence are used. 


Theorem 3.4.2 (i) If H is separable then every orthonormal subset of H is countable. 
(ii) H is separable if and only if it contains a complete orthonormal sequence. 


Proof. (i) Suppose W is an orthonormal subset of H and that S is a countable dense 
subset of H. If z,y € W and z # y then ||z —y|| = V2. Therefore for each z € W there 
exists s, € S such that ||x — s,|| < 1/2. Then s, = s, if and only if x = y. Thus the 
formula ¢(x) = sz, for c € W defines an injection of W into S. Therefore S is countable. 


(ii) If H contains a complete orthonormal sequence S then by Lemma 2.1.3, (ii) the 
Q-linear span of S is a countable dense subset of the linear span of S' which is dense in 
H. By Therefore H is separable. 

If (zz) is a dense subsequence of H, then using the Gram-Schmidt process we may 
construct inductively an orthonormal sequence (e,) such that x, lies in the linear span 
of €1,...,e,. Therefore (e,) is a complete orthonormal sequence in H.m= 


The following characterisation of completeness follows immediately from Corollary 
3.3.14 


Theorem 3.4.3 An orthonormal sequence (e,) in H is complete if and only if its 
orthogonal complement {e, : k =0,1,2,...}+ is {O}. 


Theorem 3.4.4 (Generalised Pythagoras) Let (ex), be an orthonormal sequence 
in H, where N ENU {oo}. Ifzxe€ H andn< WN then 


n 


lz — (eer? = lel? — Kas en)P (3.12) 


Proof. 7 
2 Sotererdeal? = tel —(2, Yteverden)=( Sole creme {Sole crew See 


= |lx|/? - 2 \(c,e)P. 


This inequality has a series of consequences. 
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Corollary 3.4.5 (Bessel’s Inequality) If (e,)§ is an orthonormal sequence in H 
and « € H then 


N 
» I(x, ex)? < |||’. (3.13) 


Corollary 3.4.6 Let L be the closed linear span of (e,)p-p and x € H then YN _o(x, ex) ex 
is convergent to Px, the orthogonal projection of x onto L. 


Proof. Let c') = R_o(a, ex)ex. By direct computation ||2™ —x2™)|)? = >" |(a, ex)|? 
whenever m > n. Therefore (x()) is a Cauchy sequence convergent to y = yy (2; ex)ex- 
It follows from the continuity of the inner product, Lemma 3.1.10, that 


(x —~yY ex) = jim (2 _ ae ex) = 0. 


Therefore z — y € [+ and it follows from Corollary 3.3.7 that y = Px.m 


Corollary 3.4.7 The following are equivalent: 
Gi) cel; 

(i) [22 = DX Mx, ex)? ; 

(iti) « = eo (z, ex) ex. 


Proof. Letting k — oo in (3.12) it follows that 


co fore) 
jn Pol? = je— Soe, en)enll? = llell? — Soe, eP. 
k=0 k=0 


Therefore (ii)(iii). Since x € D if and only if c = Pz the remaining equivalence follows 
from Corollary 3.4.6. —. 


Now (e;) is complete if and only if L = H and we obtain the Parseval relations. 


Corollary 3.4.8 (Parseval) The following are equivalent: 
(i) the orthonormal sequence (ex) ts complete; 
(i) |[o|? = Do tes ex)/? for all x € H; 


(iii) c = eo (x, ex)ex for all x € H, and this representation is unique. 
Exercise 3.4.9 Finals ’89, Q4, ’90, Q7. 


Theorem 3.4.10 If c = (z,)i’ € & and (e,)N is an orthonormal sequence in H, 


where N € NU {oo}, then the series S~) x,e, converges to s in H with ||s|| = ||z|| = 
L 

(Xo |eel?)?. 

Proof. Since || 7%, c,ex||? = %%, ||v||? the Cauchy condition is satisfied, and the series 


converges in H. 
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By continuity of the inner product (s,e,) = x; and ||s|| = ||z||.= 


Corollary 3.4.11 All infinite dimensional separable Hilbert spaces are zsometrically 
tsomorphic 


Proof. Let (e,)%29 be a complete orthonormal sequences H. If s € H define Us = 
((s, €k))f2o- It is easy to verify that Us € @? with ||Us|| = ||s|| and that U is linear. If 
(tp )Ro € & then 19° x,e, converges to s € H. Moreover from the continuity of the 
inner product z,; = (s,e,). Therefore U is onto and therefore unitary. Therfore every 
separable infinite dimensional Hilbert space is isometrically isomorphic to 07. = 


There are many very interesting such isomorphisms. For example that which sends 
an L?-function on [—7,7] to its sequence of Fourier coefficients may be regarded as 
an isomorphism of L?[—7,7z] and ¢*. The Fourier transform of continuous functions of 
compact support may be extended to a unitary transformation of L?. 
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Chapter 4 


Classical Fourier Series 


4.1 Fourier series 


We consider the Fourier series of complez-valued functions. 


If the classical Fourier series with complex coefficients 


I = ; 
5% + So (a cos kx + by sinkz) 
0 
converges everywhere to a function f, then f is periodic with period 27. This means 
that 


f(a +2kr) = f(x)  wheneverz C€Randk eZ. (4.1) 


If f is a complex-valued function defined on [—7,7] with f(—a) = f(a) then (4.1) 
defines a periodic function f on R with period 2x. By a periodic function on [—7,7] 
with period 27 we mean such a function or its extension. In most of what follows a 
function can be made periodic by replacing the value at +a by the average value at 
these two points. 


Lemma 4.1.1 (Riemann-Lebesgue Lemma) (Weir § 5.2) If f € L' anda ER 
then 
[f@) cosaxdz-—0, and [f@) sinaxdr—> 0 as a—- oo. 


Lemma 4.1.2 (Trigonometric identies) If 0 <j,k EN then 
Le fF 1? * 
= i cos kz cos jx dz = — / sinkz sinjudzr = 655 (4.2) 
— WT J-nx 
/ cos ke sin jade = [” cos ka de = f° sinjz dz = 0 (4.3) 


n : 1 
5 + So coskz = page =D a) (4.4) 
k=1 


2sin ae 
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1—cos(n + 1)z 


1 nr 
wei taut (4.5) 


[f Dalt) at = [ Fatyat si ; (4.6) 


Proof The identities (4.2) and (4.3) are simple calculus. 


k=1 


1 1 i} ae 1 
sin=t+2) 0 sin=«coskz =sin=2+2 5 {sin(k + =)a — sin(k — = yeh 
2 2 gure 2, 2 2 


1 
= sin(n + ae 
proving (4.4). To prove (4.5) note that 
= oe ee oe 1 n 
(n+ 1)(2sin 52)’F,(x) = $0 2sin=2sin(k + =) = D> coska — cos(k +1)z 
2 k=0 2 2 k=0 
= 1-—cos(n + 1)z. 
Equations (4.6) follow by integrating the series in (4.4) and (4.5). = 


Definition 4.1.3 (Dirichlet and Fejer kernels) 


The function D, is the Dirichlet kernel. F, is the Fejer kernel 


Definition 4.1.4 (Fourier series) 
If f € L'[—z, x] then the Fourier coefficients of f are 


a, = * i " f(t) cos kt dt as / " f(t) sin kt dt 
~_T Tv n 


for k =0,1,2,.... Note that bp = 0, and that the integrals exist. 


The Fourier series generated by f is 
1 = ' 
500 + S(ax cos kx + b, sinkz) 
0 


Much of the theory of Fourier series is to discover when and in what sense the Fourier 
series converges and whether it converges to f. 


It is a very deep result of Carleson that if f € L?[—,7] then the Fourier series of f 
converges to f almost everywhere. There exist functions in L'{[—7,7] whose Fourier 
series diverge almost everywhere. 
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The problem which exercised classical analysts was pointwise convergence. The first 
step is to express s, as a convolution of f with D, 


i 


1 i © 
Silay = 5% + So(a, cos ka + by sinkx) = ~ f : 
k=1 


FOES + D cosh — 2)} 
k=1 


| ae seems 


= * [i #@)D,¢-2) at = i [ se + 9D, ae, 
SiGe: f aad De Lave period On: Now 1, een even function and 
i ; fle +)D,(t)at = [” fle ~t)D,(—4) ae. 
Therefore 
sx(2) == ["{Fe +t) + fle — )}D,(t) dt. (4.7) 


Let s(x) € C. It follows from (4.6) that 
salt) — (0) == [{F(e +4) + fle —#) ~ 22) }Dalt) at (4.8) 


Theorem 4.1.5 Let f € L'[—n,7] be periodic with period 20 and x € [—1, 7]. Then 
8,(«) > s(x) if and only if for all 6 € (0, 7], 


1 76 
lim, — [ {f(a +t) + f(e —t) — 2s(x))}Dp(t) dt = 0. (4.9) 


M+ CO 


Proof (sin }t)~} is bounded and continuous on [6,7]. It follows that 


1 
t— (f(@+t)+f(x-t))/ sin 5t 
belongs to L’[6,]. By the Riemann-Lebesgue Lemma, Lemma 4.1.1, 
im [* fe +t) +f(e-t) 


noo Jg 2sin it 


1 
sin(n + 5 dt = 0 


Therefore (4.9) holds if and only if it holds for 6 = m. It follows from (4.7) that 
8n(x) — s(x) if and only if (4.9) holds for 6 € (0, 7]. 


“ Exercise 4.1.6 


The function F' defined by the formula 
F(0) =0 njato= t € (0,7 
= = = eee OEE T 
: t 2sin at , : 


is continuous on (0,7]. Hint. Use l’Hopital’s rule. 


ol 


Let F be as in this exercise. By the Riemann-Lebesgue Lemma 
jim af {f(a +t) + fle —£) — 2s(z)} F(2) sin(n + ot dt =0 


for all 6 € (0,7]. We immediately obtain the following corollary to Theorem 4.1.5. It 
shows that convergence of the Fourier series at z depends only the values of f in any 
neighbourhood of z. 


Corollary 4.1.7 (Riemann Localisation Theorem) Let f € L*[—7,7] be periodic 
with period 2x. The Fourier series generated by f will converge for a given value of x 
to s(x) tf and only if for some 6 € (0,7] 


Sinn t sin(n + a)t 


lim = = [ (Fe +t) + fle-t) - 2s(x))—— 2 dt = 0. 


N00 7 


We now give a test for convergence of Fourier series at a point. et 


aaa cl 
s(t) = Jim 5(f(e +4) + fle -#)) 


for each zx that this limit exists. 


Theorem 4.1.8 (Dini’s test) Suppose that f € L'[—7, 7] is periodic with period 2x 
that x € X and that s(x) exists. If the Lebesgue integral 


ir 2(f(e +t) + fe — *)) ~ sz) 5 
0 t 


exists for some 6 € (0, 7] then the Fourier series generated by f converges to s(x). 
Proof. By the Riemann-Lebesgue Lemma 


sin(n + $)t 
t 


lim [ RU@ +8) + fe —2)-s(@)} 


rm—00 


dt = 0. 

The result follows from the Riemann-Localisation Theorem. ™ 

Theorem 4.1.9 (Jordan’s test.) If f € L'[—7,7] is either (a) monotone; or (b) of 
bounded variation; in a neighbourhood of x then the Fourter series of f converges at x 
to s(x). 

Note. f is of bounded variation if and only f is the difference of two monotone functions. 
Example 4.1.10 


If f € L'[—71, x] is differentiable at x then the Fourier series generated by f converges 
to f(z). 
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Solution. Since f is continuous at x we have s(x) = f(z). Given € > 0 there exists 
6 > 0 such that : 
a(f(z +t) + f(x —t)) — s(x) 
t 


whenever t < 6. Therefore the function t — (}(f(« +t) + f(x —t)) —s(x))/t is bounded 
by f’(x) + € for t € (0,5) and the conditions of Dini’s test are satisfied.= 


— fi(z)| <e 


Definition 4.1.11 (Piecewise differentiable function) 


A function f — [—7,7] is said to be piecewise differentiable if there exists a partition 
—t = to < ty <... < t, = @ such that on (¢;,ti41) f is differentiable has a left limit 
f(t;+) at t;, a right limit f(¢;4;—) at tj,, and such that if the function f is redefined 
with these values at ¢; and t;4, it is right and left differentiable at these points. 


Theorem 4.1.12 Jf f : [t,x] — C is periodic and piecewise differentiable then its 
Fourier series converges to +(f(x+) + f(x—)) for each x € [—7, 7] 


Proof. The argument is as in Example 4.1.10 except that f(x) is replaced by $(fi,(a) + 
f'(«)) at discontinuity points. 


Exercise 4.1.13 


The Fourier series generated by f € L' may also be written 
f(x) ae > a,en 
—0o 
where a, = Tee Jt, F(a)e™ dx for n € Z. 


Exercise 4.1.14 Finals ’89, Q7. 


We now consider Cesaro summability. If f € L’[—7, x] then the Cesaro mean 


1 
n+1 


Gi 2133. Os =|" f(t) (Dolt ~ a) 4 ..0t Dat — 2) dt 


a [i fre 2) a 


us 


na) = 


© =i [Sue +) + fe-a)Falt) dt 
If0<é6<2a<7 then 


- 
~ 2(n + 1)(sin $6)? 


1 — cos(n + 1)x 


O'S Tare icin ey 


converges to zero uniformly as n > oo. 


53 


Given € > 0 there exists 6 such that |}(f(«+t)+ f(a—t))—s(zx)| < € whenever 0 <t < 6, 
Therefore 


lon(a) — a) <= f SUF(@ +4) + fe — 8) — s(x) FCO) at 


+= ["51Fle +8) + He 8) ~ 9(@) (0) 


< £ [Ro dt + -f" sl(r(@ +28) +fle-d)-s(2)IFOd 


since F,, is a non-negative function. The second integral in the last expression tends to 
zero as n —+ oo by the dominated convergence theorem. Therefore o,,(z) converges to 
s(x) whenever s(x) is defined. 


If f is continuous then f is uniformly continuous and ¢ is independent of x. Moreover 
f is bounded, s(z) = f(z) for all x € [-7,7] and o,,(x) is uniformly convergent to f(x) 
on [—7, 7]. 


Definition 4.1.15 (Cesaro Summability) 


Let {s, } be the sequence of partial sums, s, = }(§ Un of a series {un}. The nth Cesaro 
means of the series {un} is on = (uo +ur+-..+tn)/(n +1) = s,/(n +1). The series 
{un} is Cesaro summable with Cesaro sum s if the sequence {o,} converges to s. 


From the above discussion we immediately obtain Fejer’s Theorem . 


Theorem 4.1.16 (Fejer’s Theorem) Suppose f € L'[-7,7] has period 2x. The 
Fourier series defined by f is Cesaro summable to 


s(a) = Jim S(f(@ +t) + fe -2)) 


for each x for which the limit exists. If f is continuous then the sequence {o,(x)} is 
uniformly convergent to f on [—7, 7]. 


Corollary 4.1.17 If f is continuous at x and the Fourier series generated by f con- 
verges at x its sum is f(x). 


Proof. It is easy to show that if s,(x) converges then o,(x) converges to the same 
limit.™ 


Exercise 4.1.18 


Let ¢ € L***?[—z, 7] and € > 0. Show that there exists a periodic function g € C[—7, 7] 
such that ||g — ?]l2 < €. 
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—=coskz, —=sinksz, k = 
JE ee ZL, 


1,2...} are a complete orthonormal sequence in L?[—7,7]. 


: . : 1 
Corollary 4.1.19 The trigonometric functions Vag 
a 


Proof. By Lemma 4.1.2 the trigonometric functions are orthonormal. 


Suppose 0 # f € L*[—7,7] is orthogonal to the trigonometric functions. Let € < ||f'l2. 
By Example 2.1.4 L*?[—7, 7] is dense in L?[—7, 7]. By the exercise above there exists a 
continuous periodic function g such that || f—g]||z < €/2. By Fejer’s Theorem for some n 
the nth Cesaro mean a, of the Fourier series for g satisfies |o,(z) — g(z)| < €/2\/2m for 
all c € [-7,7]. Therefore ||o, — gl|2 < €/2 and by the triangle inequality || f — on||2 < e. 
Since f L o, we obtain the contradiction: 


é <Ilflla + llonlla = If — onllz < &. 


It follows that if f is orthogonal to the trigonometric functions then f = 0. By Theorem 
3.4.3 the trigonometric functions are complete. = 


Note. This corollary can also be proved using the theory of compact self-adjoint 
operators (see Exercise 5.5.5.) 
Definition 4.1.20 (Mean-square Convergence) 


A sequence s, € L?[—7,7] is mean-square convergent or L*-convergent to 
f € L*[-n, x] if 


wv 


| 
; shad? ve | 
be a 
| 
| 


Let s, be the nth partial sum of the Fourier series generated by f 


1 nr 
ale = quot S“(a, cos kx + bj, sin kz). 


k=1 


Theorem 4.1.21 If f € L*[—x,7] then the sequence s, of partial sums of the Fourier 
series generated by f 1s mean-square convergent to f. 


Proof. This follows from Corollaries 4.1.19 and 3.4.8. m 


Corollary 4.1.22 (Parseval’s Formula) Jf f € L*[—1,7] then 
1 f* | 
= [ iFlayP de = E+ Slam + [oa 
NT J—nx 2 0 


Proof. This follows from Corollary 3.4.8. = 


55 


Exercise 4.1.23 Finals ’88, Q5, 91, Q4, Q5. 


Theorem 4.1.24 (Weierstrass Approximation Theorem) Let g be a real-valued 
continuous function on the compact interval [a, b]. Given € > 0 there exists a polynomial 
p=p, such that 


lg — Plloo = sup |g(x) — p(z)| < 
€(0,1] 


Proof. It suffices to take [a,b] = [0,1]. Let g be extended to a periodic function 
f € L'[-1, x] of period 27. By Fejer’s Theorem there exists a function o given by an 
equation of the form 


N 
a(x) = Ao + )-(A;, cos kz + By sin kz) 
1 


such that |f(2) — o(z)| < €/2 whenever x € [—7,7]. Now a is a finite sum of trigono- 
metric functions and generates a power series uniformly convergent. on every bounded 
interval. The partial sums p, of this series are polynomials uniformly convergent to o 
on [0,1]. Hence for some m 


lPm(x) — o(x)| < €/2 for all x in [0,1] 
and 
f(z) — o(z)| <e for all z in [0,1]. = 


This theorem could have been proved without the use of Fourier series. It is a special 
case of the following. 


Theorem 4.1.25 (Stone—Weierstrass Theorem) Let A be a subring of C(Q) the 
ring of continuous real-valued functions on a compact Hausdorff space Q. Suppose that 


(t) A contains the constant functions; 


(11) for each pair z,y € QQ there exists f € A such that f(x) # f(y). Then A is 


dense in C(Q) for || - |loo, the supremum norm. 


Note Condition (ii) is often written ’A separates points’. 


4.2 Some Classical Orthonormal Sequences 


It follows from the Weierstrass approximation theorem that the polynomials are a dense 
subspace of L?[—1,1]. The Gram-Schmidt orthogonalisation process applied to the 
linearly independent set of polynomials {1, t,t, t°,...} yields a complete orthonormal 
basis {e,}§° of L*[—1,1]. The polynomial e, has degree n. This orthonormal basis of 
polynomials is unique up to multiplication of e, by e*. 


Definition 4.2.1 (Legendre Polynomials) 
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Let Po(t) = 1, eo(t) = 27”? and for n = 1,2,... let 


A) = soe, elt) = ttre. (4.10) 


The P,, are the Legendre Polynomials. The e, are the Legendre Functions 
Exercise 4.2.2 


Q2n+1 (m1)? 


(2n)! [ (1— erat = 


Theorem 4.2.3 The sequence {en :n=0,1,2,...} of Legendre functions is the essen- 
tially unique orthonormal sequence in L?[—1,1] obtained by applying the Gram-Schmidt 
process to the sequence of polynomials {t” :n =0,1,2,...}. 


- Proof. Let un, = (t? — 1)” and denote Sn by u™. Ifm <n then 


[ uu) = =i uD) — ie ur Dylm#?) = a (- ae lr) ,2m) 
i = By 


= (-1)" 2m)! f (2 = 1yYo—™ at 
-{{ (Qn)! ft,(1—#)"dt ifm=n 


otherwise. 
Therefore the P,, are orthogonal and by Exercise 4.2.2 it follows that 
1 2n+1 1 7 iad (i 
2 
re = = 1 = soe 
iG ) 2 2r(n!)? | ont 1 at rte 

Exercise 4.2.4 

Show that (¢? — 1).P/"(t) + 2¢P/(t) — n(n + 1)P,,(t) = 0. 
[Hint. (t? —1)ul, = 2ntu,.] 

Consider the linear operator T with domain C?[—1,1], the twice continuously dif- 
ferentiable functions on{—1,1], given by T f(t) = [(t? —1)f']’. The above exercise shows 
that T’ has a complete orthonormal basis {e,} of eigenvectors (eigenfunctions). T is 


unbounded essentially self-adjoint. Equations of the form Tf = g for many g may be 
solved by expressing g as )7(g,€n)e€n. 


; Definition 4.2.5 (Laguerre Polynomials and Functions) 
~ For « € [0, 00) and n = 0,1,2,... let 

a a e/2L, (x 
Ine) = Soa), yale) = 2 Fale), 
The L,, are the Laguerre Polynomials and the y, are the Laguerre Functions. 


(4.11) 


n! 


57 


Theorem 4.2.6 The sequence {y, :n=0,1,2,...} of Laguerre functions is the essen- 
tially unique orthonormal sequence in L*[0,00) obtained by applying the Gram-Schmidt 
process to the sequence {r"e~*/? :n =0,1,2,. Be ks 


Proof. Jt is immediate that L, is a polynomial of degree n. 


m—1 


aoa Pee gees no —-x ia OF oe ce ni —-x 
i er ners L qaqa (tne )de =—m | cD qgeai te ) dz 


quem 


= m(m— yf grt <= = ——-(s"e~*) de = =e 1yrmt [> + cee (ae "dr = 0 


whenever n > m. Therefore if n > m it follows that 


i OL t)bm(2) de = (nlm!) 7 Pn(XL)Pm(x) dz = 0. 


If n= m then 
- -“£72 | iz n d” - = 
[ C7 L(2jae= | (—1)"2” —(2"e~*) dz = nt [ 
0 0 ax” 0 


and the sequence {y,} is orthonormal. Since L, is a polynomial of degree n it follows 
that y,, is in the linear span of {e~°/?2™ : m = 0,1,...,n} so that it is obtained from 
the Gram-Schmidt process as claimed. m 


ae * de = (n!)*, 


Theorem 4.2.7 The generating function for the Laguerre functions is 


—43[(1+t)/(- t)Jx = Dt en(2), 


1 
g(z,t) = 7 


for c >0 and |t|< 1. The sum converges pointwise and in L?{0,0o)-norm. 


ae 
—2x = 3 et nix —x nl gn 
Leena) oh FS Ser Frenne Ep 
n!} Ue 
/ n=0 n=0 n=o / 
-—2 = n n 
aoe (Ft 
tk - 2041) /(1-O]e 
— el? 5 oe pe et 


for each z € [0, 00) 2 te ae ‘s 


Ift € (—1,1) then 5 t”||¢n||2 = (1-t)~*. By Lemma 3.2.2 7°, t"y,, is convergent 
almost everywhere and in L?-norm to g(z,t). ™ 
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Corollary 4.2.8 If f € L?[0,00) and (f,yn) = 0 for n =0,1,2,... then (f,e7%7) = 0 
for alla >0O. 


Proof. This uses the continuity of the inner product and the fact that a = +(14+t)/(- —t) 
runs from 0 to co as t runs from -1 to +1.m 


Corollary 4.2.9 The Laguerre polynomials form a complete orthonormal sequence for 
L?[0, 00). 


aes Suppose f is as above. Using the transform € = e~* the function g(é) = 
72 f(—log €) is in L°(0,1] and f° |f(x)|? dx = fo |\g(€)/? dé. Then 


[Pi@etae = f[oeert = 0. 


If p is a polynomial such that {5 |g(£) — p(é)/? dé < e? then fo |g(é)? dé < 2 and g =0 
almost everywhere and in L7[0,1]. Therefore f = 0 almost everywhere and in L?{0, 00). 
" 


Exercise 4.2.10 Finals 91, Q6. 
Definition 4.2.11 (Hermite Functions and Polynomials) 


For ¢ € Rand n =0,1,2,... let 


enn? /2 


‘Hy (x) = (-1)"e si ~(c = )- vafz) = Hn(@) 7a pl)ioqale” (4.12) 


The H, are the Hermite Polynomials and the ~, are the Hermite functions. 


Theorem 4.2.12 The sequence {y, :n=0,1,2,...} of Hermite functions is the (es- 
sentially unique) orthonormal sequence in L*(—0o, 00) obtained by applying the Gram- 
Schmidt orthogonalisation process to the sequence {x"e~* /? : n = 0,1,2,.. he 


Proof. It is immediate that H, is a polynomial of degree n. They have a generating 
function 
Hn(£) yn 


) = ent? +2tx a ate He)? 5 ate) 
n! 


n=0 


y(2,t (4.13) 


Now “elt ‘) 


= 2ty(z,t) and since the series may be differentiated term by term 


Hi te)> =, Int «(2) rae Cee 


If n > m then 


/ Hy(2)H,(e)e-" de = (-1)" : Hy(2)4—(e™) de 
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= (| ik alin 
= (-1"2"mt | Ho(2) = ale) da 


= aa i n= 


0 otherwise. 


Therefore {v%, :n = 0,1,2,...} is an orthonormal sequence, and since ~, is in the linear 
span of {are wl? :n = 0,1,2,...,n} for each n it follows that the hermite functions 
may be obtained using the Gram-Schmidt process as claimed.—™ 


Theorem 4.2.13 The Hermite functions {y, : n = 0,1,2,...} are a complete or- 
thonormal sequence for L*(—co, 00). 


Prook Let L be the closed linear span of the Hermite functions. If J € L?[—o00, 00) and 
g(u) =u —3 f(u2) for u > 0 then using the change of variables u = 2? gives g € L?(0, 00). 


By the completeness of the Laguerre functions if « > 0 there exists a scalar sequence 
Co; C1,--., Cn such that 


00 eel. 
[ (g(u) — u2(>> ene yktt/2y)2 ae 
0 
Changing variables 
a N 
| (f(x) - Soe? ey at)? dae: 
e 0 
If f is an odd function then 
0° N ‘ 
/ (f(x) — So e7® Peya**1)? da < 2? 
mb 7 


and f € L. If f 1 L then f = f,+ fo where f, is odd and fo is even and in L?(—0o, 00). 
Since (fi + fo, fi) = || fill? = 0 it follows that f is even. Therefore 


| f(x)e~? 12.47 aa = i g(uje uk du Ol Deva. 
0 


It follows from Corollary 4.2.9 that g = 0 a.e. so that f = 0 and the Hermite functions 
are complete by Corollary 3.3.14.m 


Exercise 4.2.14 Finals ’88, Q7. 
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Chapter 5 


Spectral Theory 


5.1 Analytic Banach Space-Valued Functions. 
Definition 5.1.1 


Let 2 be a domain in C and let X be a Banach space. A function F : Q => C is locally 
analytic on 2 with derivative f’ if 


| f(z +h) - f() 
h 


Note. If f is locally analytic then ¢o0 f is locally analytic for all 6 € X*. The converse 
is true but the proof requires the uniform boundedness principle which is not covered 
in these notes. 


-f@| +0 whoo. 


Definition 5.1.2 


Let f : Q — X be continuous, and let 7 : [0,1] - C be a contour in 2. The contour 
integral of f along ¥ is defined as the limit of Riemann sums 


f f(@)dé = lim for 1) — (4). 


Arguing as in the complex case but using || - || instead of |-| this converges in X and 
the limit is independent of parametrisation of 7. Moreover 


| § Fle)ae] <  tength(y) max{f(o(#)) :# € [0,1]} (5.1) 


If 6 € X* then 
(grea) = fore@vae. 


61 


Theorem 5.1.3 (Cauchy Theorems) [f f 2s a locally analytic function on a domain 
Q in C and ¥ is a simple closed contour in Q then 


£70 dé =0 


fle)= 55 f Po ae 


whenever z lies within +. 


Proof. By Cauchy’s formula 
suey o(f 2 ae) as) = «sey - fUED a = 0 


for each ¢ € X*, proving the second identity. The proof of the first is similar. m 


Theorem 5.1.4 (Laurent Expansion) Suppose f is a locally analytic function on 
the annulus r < |z| < R with values in the Banach space X. Then f has a unique 
Laurent expansion 


{a= Jrer 
uniformly convergent on compact subsets of the annulus, where c, € X is given by the 


formula ' 
x, at FE 
m = sof, dé 


2mi J\gl=p Er? 


wherer<p<R. 


Proof. Let r < py < |z| < po < R. By Theorem 5.1.3 


ro ~ HL eu 4 £24) 


Using the norm bound (5.1) 
IO) 


az—€ 


= f (3 seers) dé = Soe f F(E)E" dé. 


By Cauchy’s theorem 7, may be deformed to y. A similar expansion in the integral 
round ‘yz yields the other terms.m™ 


5.2 Spectrum and Resolvent 


In this section we consider a bounded linear operator T : X — X in a complex Banach 
space X. 
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Theorem 5.2.1 [fT € L(X) with ||T|| =a<1 then I—T is invertible with bounded 
inverse 


(I-T)? =F47T47'+...47"% +... 


the series converging in the operator norm. Moreover ||(I —T)~'|| < (1-—a)7}. 


Proof. If S, = 4 T* then 
IISn— Smll = 22 TS Do MTS Do’ 
m=1 m+1 n+1 


<a™(1—a)" 


and (S,,) is a Cauchy sequence in L(X). By Example 1.5.17 (ii) L(X) is complete, so S, 
converges to S € L(X). Since ||5,|| < (1—a@)~? for all n it follows that ||$|| <(1—a)71. 
Now 


(I-T)S = lim (I -T)S, = lim (I - f Biaiee ae b 
since ||T"|| < a” > 0. Similarly S(I — T) = I, and S is the inverse of [—T. m= 
This series may converge when ||T'| > 1. For example if X is the Euclidian space 


0 
2 = 
C ond T= (} 0}: 


Proposition 5.2.2 Let \ € C and suppose the series T° AMY T" converges in the 
operator norm. Then AI —T has a bounded inverse 


Rly Se" OFS = Seer 


0 
with ||Rx(T)I] < (AL — ITID~. 
Definition 5.2.3 
The Resolvent set of T: p(T) ={AE€C:AI—T_ has a bounded inverse } 
The function \ — R)(T) = (A— T)"! from p(T) to L(X) is the resolvent of T. 
The norm of the resolvent is denoted Ny. 
Definition 5.2.4 
The spectrum of T is o(T) = C — p(T). 
A € C is an eigenvalue of T with eigenvector e € X if e £0 and Te = Xe. 


The point spectrum o,(T) is the set of eigenvalues of T. 
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The continuous spectrum ¢a,(T) is the set of \ where \— T has a densely defined 
but unbounded inverse. 


The remainder is the residual spectrum o,(T). 


Exercise 5.2.5 
Let {a; :7 = 1,2,...} be dense in [0,1] Define T,, 7) € L(€*) by putting 


T,(21,22,23,...) = (Oa ys. fas%350s) 
To(21, 22, 23,-..) = (a421, A222, 03%3,...) 


whenever (21, £2, %3,...) € &. Find the point, continuous and residual spectra of T, Tp. 
Theorem 5.2.6 If u € p(T) then  € p(T) whenever |A — p|N, <1. moreover 

Hi, = w —r)R", 
the sertes converging in the operator norm. 


Proof. Since J —-T =(A—p+p)I —T it follows that (AJ —-T)R, = I —(w—2)R,. 
Now ||(u — A)R,|| = |A— #|N, <1, and by Theorem 5.2.1 the operator (AI — T)R, 
has bounded inverse S with ||S|| < (1 —|A— |N,,)~?. Therefore (AJ — T) has bounded 
inverse Ry = SR, with ||Ry|| < N,(1—|A— p|N,)-!. By Theorem 5.2.1 


Ry = SR, = SD(u—AR. 
8) 


Corollary 5.2.7 The resolvent set p(T) is open. The spectrum o(T) is compact. 


Proof. Tf uw € p(T) then {A : |X — p| < N7*} C p(T) and p(T) is open. If || > ||TII 
then ||A~?T'|| < 1 and (I — A~'T) and therefore \J — T has bounded inverse. Therefore 
A € p(T). Therefore o(T) is closed and bounded. m 


Theorem 5.2.8 [fT € L(X) and 4, € p(T) then 


RR, = RR (5.2) 

Ry,-R, = (u—A)R)R, Resolvent identity (5.3) 
d” : : 

d\" Ry = (—1)"n! Ret (5.4) 


Proof. Multiplying the identity (uJ —T) —(AI—T) = (w—A)I on the right by R, and 
on the left by Ry gives equation (5.3), from which equation (5.2) follows by symmetry. 
Suppose now that |A — p|N, <1. Then 


(Rx — Ry)/ — 2) + Rill = ]Ra( Ra — R,)I| = OA — eR, R3| < [A — pl | Rall | R5I 
<A — pw] Ral — [A — ef Ral. 
Therefore J 
Dm = lim(Ra — Ry)/A- 4) = —By 


in the operator norm. For larger n Equation (5.4) follows by induction. 
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Corollary 5.2.9 If f € L(X)* then the function \ > f(R)\(T)) is analytic on p(T). 
Proof. Since f is continuous 
limA > pf(Ry — R,)/(A—#) = —F(Ri) 


for 4 near Xin p(T). = 


Theorem 5.2.10 If X 1s a Banach space and T € L(X) then the spectrum o(T) is 
nonempty. 


Proof. If o(f) = § and f € L(X)* then p(T) = C and f(R)(T)) is entire analytic. 
By Exercise 5.2.2 ||Ra|| < (JAIZ — ||TI])~? and ||Ry{| - 0 as |A| — oo. Therefore 
f(R\(T)) > 0 as |A| > oo. By Liouville’s Theorem f(R)(T)) = 0 for all f € L(X)* 
and R(T) = 0 which is impossible. Therefore o(T) 4 0.m 


Theorem 5.2.11 (Spectral Mapping Theorem for Polynomials) If X is a com- 
plez Banach space and p 1s a polynomial then o(p(T)) = p(o(T)) 


Proof. Let p be monic of order n. If w € € then 


p(T) — wl = (T— fyL)...(T — Bal), 


where f1,...,8, ar the zeros of p(x) — pw. If 8; € p(T) for? = 1,...,n then each term 
on the right has bounded inverse so that yw € p(p(T)). But p(8;) = yu for all i so that 


o(p(T)) C p(o(T)). 
If w € p(p(T)) then 


R,(p(L)(T — fil)... (LT — Bnr2)(T — Bal) 


=(T— BINT — Bl)...(T- PraDR(oT)) = I. 
Therefore T — 8,I has bounded left and right inverses so that 6, € p(T). Therefore if 
Bn, € o(T) then p € o(p(T)). Since u = p(f,) it follows that p(o(T)) C o(p(T)).— 


If f is an analytic function whose domain contains the spectrum of T it is possible 
to define f(T’) using the power series expansions of f. For example if f(z) = e” then 


f= =F 


ni 


The Spectral Mapping Theorem applies to f: o( f(T)) = f(o(T)). 
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Definition 5.2.12 (Spectral Radius) 
The Spectral Radius of T is 
ro(T) = sup{lA]:A € o(Z)} 
It follows from Exercise 5.2.2 that r,(T) < ||T'|. 


Theorem 5.2.13 The series (3° A~(@+0T" is uniformly and absolutely convergent to 
R(T) on compact subsets of {XE C:|A| > ro(T)}, and divergent for |\| < r,(T). 


Proof. By Exercise 5.2.2 the series converges to R,(T) for |A| > ||T|]. By Theorem 
5.1.4 it is the Laurent expansion for Ry, convergent for |A| > r,(T). 


Tf ye Ag, (mt) pn is convergent then it converges to R),(T) and 


OelaD)S era Toe 
0 


is convergent. Therefore the sequence {9 a haa is bounded and the series is ab- 
solutely and uniformly convergent to R(T) on compact subsets of {|A] > |Ao|}. If 
Ao] < A < r.(T) with X € o(T) then R, does not exist, so the series diverges for 
Ao <ro(T). = 


Theorem 5.2.14 (Spectral Radius Theorem) The spectral radius 
ro(T) = lima, Tall". 


Proof. From the previous theorem r,(T) is the radius of absolute convergence of the 
Laurent series for R,(T). Therefore 


r(T) = limsup|[7™||/” 


By the spectral mapping theorem o(T”) = {A" : X € o(T)}, and r,(T”) = [ro(T)]” < 
\|T"||. Therefore r,(T) < ||T"||}/". It follows that 


ro(T’) < liminf ||T™||/”. = 


‘Let Ar ={f:C > C: f is analytic for |z| < R}. If f € Ap and f*(z) = f(z) then 
f* € Apr. The operation f — f* is an involution and Ap is a *-algebra. If ||T|| < R 
then each f € Ap has a Taylor expansion f(z) = 38° a,z* and the series 


f(T) = St aT* 


is absolutely convergent and defines a linear operator f(T) € L(X). 
Suppose g is analytic for |z| < R, and a, 8 € R, then 


(af + Bg\(T) = of(T) + Bg(T), fo(T) = F(P)g(T) F(T) = FT") 
and the map f — f(Z') is a *-algebra homorphism from Ap into L(X). 
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By Exercise 5.2.2 


PM R(T) = $ POM = of OMT dy = oni TK. 
2 Yo o vy 


where y is the contour |A| = p where R > p > ||T||. The Taylor series of f € Ap is 
uniformly convergent on 7, so integrating term by term gives the following Cauchy type 
representation of f(T). 


1 ¢ fA) 


an ae Caer haa 


f(D) = sf fORCT)A = 


Using Cauchy’s theorem for L(X) valued locally analytic functions the contour y may 
be deformed to any simple closed contour containing o(T). If o(T) is disconnected then 
may be replaced by a series of simple closed contours around the components of o(T)). 


Exercise 5.2.15 Finals ’88, Q4, ’89, Q6, ’90, Q6, 791, Q7. 


5.3 Unitary and Self-Adjoint Operators. 


As in the finite dimensional case unitary operators describe the isomorphisms between — 
Hilbert spaces which preserve distance. 


Definition 5.3.1 


Let H be a complex Hilbert space. 
T € B(H) is unitary if TT* = T*T = I. 
T € B(#) is self-adjoint (hermitian) if T= T*. 


If T is unitary then T is a bijection. If K is another Hilbert space then each 
T € B(H,K) has a Hilbert-space adjoint T* € B(K,H). Then T is unitary if T*T = 
I € B(H) and T*T =I € B(K). In the finite dimensional case unitary operators have 
unitary matrix representations with respect to orthonormal bases. 


Theorem 5.3.2 Let H be a complex Hilbert space. If U,V € B(H) are unitary then 
(i) U is an tsometry; 

Gi) ON = 1; 

(iii) U* = U-? is unitary; 

(iv) UV is unitary; 

(v) o(U)C {A EC: [A] = 1}. 
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T € B(A) is unitary if and only if T is isometric and surjective. 
Proof. (i) and (ii) follow since ||Uz|? = (Uz,Ux) = (U*Uz,z) = |{z||?. From the 
definition U* is defined on all of H and is a left and right inverse of U, and U** = U 
gives (iii). Then (UV)* = V*U* and (iv) holds. 


Since ||U*|| = 1 the series 7§° A"U*(+») is uniformly convergent for |A| < 1 to Ry 
giving (v) and (vi). 


Suppose T’ is isometric and surjective, then T is bijective. Since (Tx, T'x) = (z, x) 
for all « € H the polarisation identity (3.10) shows that 


(T*Tx,y) =(Tx,Ty) = (z,y) whenever x,y € H. 
Therefore T*T = I and T* = T-!. It follows that T*T = TT* = I and T is unitary. ml 
We now consider self-adjoint operators. As in the finite dimensional case: 


Theorem 5.3.3 T € B(A) ts self-adjoint if and only if (Tx, 2) is real for all z € H. 
Proof. lf T is self-adjoint then 


(Tx,x) = (x, Tz) = (Tz,z) ER 
If (Tz, x) is real for all X then forallae Canz,yeX 
(T(ax + y), (ae +y)) = la|(T2, 2) + (Ty,y) + o(Tz,y) + a(Ty, 2), 
and a(Tz, y) + @(z, Ty) is real. Putting a = 1 and i shows that the real and imaginary 
parts of (Tx,y) and (z,Ty) are equal and T is self-adjoint.m 
Theorem 5.3.4 [If T € B(H) ts self adjoint, and X is an eigenvalue of T then X is 
real. Moreover ergenvectors corresponding to different eigenvalues are orthogonal. 
Proof. If X is an eigenvector of \ then 
Moe) sNere) = (Tee) Sie Ta) =e Ae) = Aloe), 
and \ is real. 
If y is an eigenvector of 4 # \ then 
Mz, y) = (Az, y) = (T2,y) = (2, Ty) = (x, py) = wz, y) 


and (zr, y) = 0." 
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Theorem 5.3.5 [fT € B(A) ts self-adjoint and \ € C, then \I —T has a bounded 


two-sided inverse if and only if there exists kK > 0 such that 
| AL — T)z|| > «||z|| whenever « € H 
Proof. Vf T, = I — T has a bounded inverse and z = (T)\)~“ty € H, then 
MD)ell = MBIT)“ vl = Holl = MC) MD) = BY 

Suppose conversely that ||(T})z|| > «||z|| whenever x € H. It follows that (T\)(x) = 
0 implies x = 0, and (Tj) is injective. Moreover, if {(T,)z,} is convergent to y,,, then 
{(T))z,} and therefore {x,} is a Cauchy sequence. If {z,} converges to z,, then since 
T is continuous, (T\)t. = Yoo and Im(T)) is closed. If y 1 Im(T)) then 

(x, (AI —T)y) = (AI —T)z,y) = 0 whenever x € H 


and Ty —Ay = 0. It follows from Theorem 5.3.4 that is real so that [Zry|| = «lly|| = 0. 
By Corollary 3.3.14 Im(T,) = H. If S : Im(Z\) > JF is the inverse of (T,) and 
y =(T\)x € A then 


IISyll = lel = ISD) < 6" I(Da)2|] = «Ill whenever x € H 
and S = (T,)~! is bounded. m 


Corollary 5.3.6 (Real Spectrum) [f T € B(H#) is self-adjoint then o(T) CR. 


Proof. Ifa - 78 € C, then (i8z,(T — al)x) = iB((T — al)z,x) = —((T — al)z, iBz). 
Therefore 
(LT — (a + iB)1)a, (T — (a + if)I)z) 
= ||(T — aD)x\|’ — (LT — af)x,iBx) — (iB2,(T —al)x) + 6*|\x|? > B?|lx|)’. 
It follows that if 6 # 0 then T — (a +76) has a bounded inverse and o(T) € Rm 


Exercise 5.3.7 (Cauchy-Schwarz Inequality) 
If S is self-adjoint in B(H) and (Sx, x) > 0 whenever z € H then 
(Sz, y)|? < (Sz, x) (Sy, y) whenever x,y € H 
Hint. Consider the quadratic g(€) = (T(x + €y), a + €y). 
Definition 5.3.8 
If T € B(A#) is self-adjoint then 
mT) = inf (Tz,x2) < sup (Tx,x) = M(T) 


|]ecj]=1 ||x{[=1 
Theorem 5.3.9 If T € B(H) is self-adjoint then 
{m(T),M(T)} Cc off) C [m(T), M(T)] 
Proof. If M(T) < A €R then for all ze € H 
(A-— M(T))||z|? < (AL —T)z, 2) 


and by the Cauchy-Schwarz inequality ||(AJ — T)2|| > (A — M(T))||z|| and A € p(T) by 
Theorem 5.3.5. Similarly (—co,m(T)) C p(T) and the right hand inclusion follows. 
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If \ = M(T’) then by Exercise 5.3.7 with S$ = \I ~T, =z and y = (AI —T)z 


inf AL —T)z|* < inf (AL —T)z,2)((Al ~ T)z, (AL —T)z) = 0 


and X € o(T) by Theorem 5.3.5. Similarly for \ = m(T) and the right hand inclusion 
follows.m™ 
Theorem 5.3.10 [If T € B(H) is self-adjoint then 


[ZI] = max{n(T)],|MCE))} = sup (Te, 2)| = re(T) 


Proof. By the previous theorem r,(T) = max{|m(T)|, |M(T)|}. Moreover 
||? = sup (Tz, Tx) = (T?z, 2) = M(T’). 
Ile||=1 
Ifu > r,(T) then ci — p?l) = (T + pI)(T — pI) has a bounded inverse. This gives a 
contradiction if yu? = ||T||? = M(T?). Therefore ||T|| = r,(T).m 
Theorem 5.3.11 [fT € B(A) is self-adjoint then o,(T) = 9. 


Proof. If X € o,(T) then Im(AI — T) is not dense in H. Let y be in the orthogonal 
complement. Then for all c € H 


(AI — T)z,y) = (2, (AT ~ T)y) = 0. 


Therefore 4 is an eigenvalue, is real, and is in o,(T). ™ 


5.4 Spectral Theorem for Compact Self-Adjoint Op- 
erators 


The theory of compact self-adjoint operators in complex Hilbert space is the closest 
to that of Hermitian matrices in C”. In particular such operators have a complete 
orthonormal basis of eigenvectors, and so have an "infinite diagonal matrix representa- 
tion”. There are many examples of compact operators arising in the theory of integral 
and differential equations. Although the syllabus refers only to compact linear operators 
in Hilbert space many of the properties hold in Banach or normed vector spaces. 


We recall a result from topology (Sutherland Theorem 7.2.13.) 
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Theorem 5.4.1 Let X be a subset of a complete metric space Q. Then the closure X 
of X 1s compact if and only if every sequence {x,} in X has a Cauchy subsequence. 


Definition 5.4.2 


let X be a normed vector space A linear operator T: X — X is compact if the image 
of the unit ball has compact closure: 


{Tx : ||x|| < 1}is compact 
Exercise 5.4.3 
(i) T € B(X) is compact if and only if for each bounded sequence {z,,} the sequence 
{Tx,} has a convergent subsequence. 
(ii) If T has finite rank (i.e. Im(T) is finite dimensional) then T is compact. 
(iii) If X is infinite dimensional then the identity operator is not compact. 


(iv) Let L be a subspace of X and suppose that T(Z) C L. Then the restriction Ty is 
compact. 
Lemma 5.4.4 Let X be a Banach space. If T : X — X is compact then T is bounded. 


Proof. If By is the unit ball in X then T(B,) is compact and therefore bounded 
(|| - || : T(B1) — R is continuous and therefore bounded).m™ 


Theorem 5.4.5 The set K(X) is closed for the operator norm and is a two-sided ideal 
in the ring B(X). Namely 


(i) K(X) is a linear subspace of B(X) 
(ii) If S € B(X) and T € K(X) then ST,TS € K(X). 
; 


Proof. We may suppose ||T,|| < 1 for all n. Suppose {T,} C K(X) is convergent 
_to T € B(X). Let {x,}§° be a sequence in the unit ball of X. Since T,, is compact 
"we may recursively define subsequences {x }2,, n = 1,2,... such that {2'"*} is a 
subsequence of {a} for each k and 


Ta(2& — 2] < 1/2". 


Given € > 0 there exists N = N, such that ||T — T,|] < ¢, ||T, — T,,|| < ¢, and 1/2" <e 
whenevern >m>WN. 


Pal) — tl |] < I(T — Tn) || + (Le — Tn) || + [| Zn (2) — 2] + [En — T) 2 | 


< 5e 


whenever n > m > N,. Therefore the sequence {T'z,} has a Cauchy subsequence {2!")} 
and T is compact. Therefore K(X) is closed for the operator norm. 
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(i) If S € B(X), T € K(X) and {z,} is a bounded sequence in X then there is a 
subsequence {x)} such that {$2}, {Tx} and {($+T)x} are Cauchy. Therefore 
S+T is compact. If a is a scalar then aT is compact and K(X) is a closed linear 
subspace of B(X). 


(ii) Let {x,} be a bounded sequence in X. If S € B(X) and T € K(X) then {Sz,} 
is bounded so that {7Sz,} has a convergent subsequence. Therefore TS € K(X). 
Furthermore {T'z,} has a convergent subsequence {Tx,,} and {STz,, } is convergent. 


Therefore ST € K(X), and K(X) is an ideal.=. 


Proposition 5.4.6 Let {en} 9 be an orthonormal sequence in H and let {\,} be a 
sequence of real numbers such that |r,,| 2 0 as n > co. The formula 


ros S An({Z, €n)en whenever « € H (5.5) 


0 


defines a compact linear operator in B(H) with ||T|| = max, |A,|- 


Proof. If c € H then by Bessel’s inequality 
— 2 ae 2+ le 2H a |]2 
Pal (2, €n)|" < max |Ag| 2 \(#, en) < max |A,|"|[x|I°. 


By Theorem 2.4.9 the series (5.5) converges to T'x € H with ||Tx|| < max, |A,| ||x}]. The 
transformation T is linear and ||T'|| < max, |Ax|. 


Suppose Tz = 37} An(z, en)en, then J; is of finite rank, and therefore compact. Now 


Gana 5. eee: 


k+1 


Therefore ||T — T,|| < maxn sx |An| — 0, and T is compact by Theorem 5.4.5. m 


Theorem 5.4.7 Let H be a Hilbert space, and let T € B(H) be a compact self-adjoint 
operator. If \ £0 is an eigenvalue of T then 


(1) the eigenspace Ny = ker(\ — T) ts finite dimensional; 
(ii) the closed subspace N\* is T-invariant; 
(iti) the restriction T|Ny* is compact and self adjoint. 
Proof. (i) If My is infinite dimensional then it has an orthonormal basis {e,}. Then 


{Te,} = {Aen} has no convergent subsequence since |len — em|| = V26mn- This contra- 
dicts the compactness of T’. 


(ii) If € M\* then (Tz, y) = (x, Ty) = (a, Ay) = 0 whenever y € Ny, and T(N\*) C 
Nie | 
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Theorem 5.4.8 Let T € B(H) be compact. If {A,} is an infinite sequence of distinct 
eigenvalues of T then {\,} converges to 0. 


Proof. By the Bolzano—Weierstrass Theorem the sequence has a convergent subsequence 
again denoted {A,,}. If A, + A # 0 then given there exists N € N such that |\,,| > \/2 
whenever nN > N. Choose normalised eigenvalues e, corresponding to \,. Since the 
A, are distinct they form an orthonormal family. 


[Ten — Tem] = ||Anen — Am€m|| = (|Anl? + [Am|2)? > [Alv2 


whenever m,n > N. Therefore and {Te,} has no Cauchy subsequence, and T is not 
compact. 


Theorem 5.4.9 If T’ € B(H) is compact and self-adjoint then ||T|| or —||T|| ts an 
eigenvalue of T. 


Proof. If T # 0 then by Theorem 5.3.10 either m(T’) = infy.y-1(T'z,z) = —||T|| or 
M(T) = supya=1(T'z,z) = ||T||. Therefore there exists 1 € R with |\| = ||Tl] and a 
sequence fact in H with ||z,|| = 1 such that (Tz,,2,) — A. Now 


Tz, — Az, ||? = ||Tx,||? — 2A(T ap, en) +? < 20? — 24(T en, 2,) > 0. 


Therefore Tz, — Ax, — 0. Since T is compact there is a subsequence {z,,} such that 
Tz, > y € H. Therefore ||Arn, — y|| < |len, — T2n,|| + |lten, — yl] and Ata, — y. 
Therefore 

Ay = Jim. Ata tim TX = Ty, 


Hence Ty = Ay and 4 is an eigenvalue of T. m 


Corollary 5.4.10 
|Z'|| = max{|A| € C: A € o(T)} = max{|\|: \ is an eigenvalue of T}. 


Theorem 5.4.11 (Jordan Canonical Form) Let T € B(H) be compact and self- 
adjoint. 


(i) ker(T')* has an orthonormal basis {e,}*_, of eigenvectors of T, where N can be 
an integer or oo. If {An} 18 the corresponding sequence of eigenvalues then {|\n|} is 
monotone decreasing and converges to 0 if N = co; 


(ii) If x € H then 
N 


Tz = > Aika, e;)e; 


0 
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(iii) {e,} is an orthonormal basis of H if and only if ker(T) = 0. 


Proof. Define a sequence of quadruples {e,, \n, Hn, T,} where 
(a) {e,} is an orthonormal sequence of eigenvectors of T; 

(b) {An} is the corresponding sequence of eigenvalues; 

(c) |An| > |Anga| for all n; 

(d) Ho = H and H,, = {eo,...,e,_1}+ are T-invariant; 

(e) fh =T, T, =T|Z, is compact and 


[An] = [Tall S []Zn—al] = |An—a| 


as follows. Let \; be an eigenvalue of T with |A,| = ||Z'|| and let eo be an eigenvector of Ap 
with ||eo|| = 1. By Theorem 5.4.7 the closed subspace H; = ed is T-invariant, and T, = 
T|H, is compact. Suppose now that {e,, Ax, Hz, T,}-9 have been chosen satisfying (a) 
to (e). Then Anyi = Ngo eg is T-invariant. If Taz. = T|Hnta = Ta| Ani then |Tn4il| < 
|Z]. By Theorem 5.4.9 there is an eigenvalue \n41 of Tr41 with |Angi| = ||Tn4i{| and 
corresponding normalised eigenvector €,4;. Therefore the sequence {e,, x, Hz, f Gs 
satisfies the conditions (a) to (e). 


If the sequence is finite then T, = 0 for some n. If ¢ € H then 2, = x — 
Eos €n)éen € H,. Therefore 


n-1 n—-1 
0 = T(x — 30 (x, nen) = Tr — S~ Anz, en)en 
k=0 k=0 


If the sequence is infinite then by Theorem 5.4.8A, — 0 and JT, > 0 as n — oo. Then 
n-1 
[Px — So An(x, en)enll = [Tr2nll < [Tal [lanl] = [nl lenl] < [nl |lzl] > 0 
k=0 


and 


Tes  . €n)en- . (5.6) 


0) 


Corollary 5.4.12 The spectrum of T is the closure of a countable set of eigenvalues 
whose only possible limit point is zero. 


Proof. LetO #A€ Rand » F A, for all k. IE |A,| < JA] then \ € p(T,) and \ € p(T|H}t) 
so that ’ € p(T) with R(T) = R(T) ® R)(T|H+). Therefore o(T) — {0} = {Ani n= 
Oj 2,.2. 8 Tee etey w= 0; 1-2: then 

(Tt te) en Nee.) 0; 


and Tz = 0 by Equation (5.6). Therefore 0 is an eigenvalue of T. m 
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5.5 Symmetric L’-Kernels. 
Definition 5.5.1 (Symmetric L?-kernel.) 


A symmetric L’-kernel on (a,6) C R, is a complex-valued function k € L?({a, 6] x 
[a, b]), with k(s,t) = k(t, s) for almost all (s,t) € [a, }] x [a, 8). 


Theorem 5.5.2 Let k be a symmetric L?-kernel on (0,1). The formula 
‘ 2 
(KA(s) = ff Ms,ef(t)at f € (0,1) 
defines a compact self-adjoint operator K in B(L*[0,1]) with ||K|| < ||kllo. 
Proof. If f € L7(0,1] then f x1 € L?({0, 1] x [0,1]) and kf € L*[0, 1] x [0,1]. By Fubini’s 


theorem for almost all s the function t > k(s,t)f(t) is in L*[0,1], and the function 
t + k(s,t) is in L?[0,1]. By the Cauchy-Schwarz inequality 


Kfll2 = ie iE k(s,t) f(t) ail dees [ ([ \a(s,t)/? at) Ge \f(P at) de 


= II Filla Walls 
Therefore K € B(L*(0,1]). If f,g € L?(0, 1] then 


(K f,9) = 7: Rs, t)f(s)gB dsat = if f(s)k(s, t)g(t) ds dt = (f, Kg), 


and K is self-adjoint. 


If {e, }§° is a complete orthonormal sequence in L?[0, 1] then ¢pm(s,t) = en(s)em(t) 
- defines a complete orthonormal sequence in L?({0,1] x [0,1]}). If 


N 
kn = y (k, nym) Pn,m 
m,n=0 


and ' 
Kwf(s)(s) =f ky(s,t)f(t) at fe L(0,1] 


then Ky is finite rank, and therefore compact. Since ||K — Ky]|| < ||k — ky|| > 0 as 
N — ov it follows from Theorem 5.4.5 that K is compact. m 


Example 5.5.3 
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Consider the differential equation 


—y"(a) =f(x) ae., (5.7) 
with boundary conditions 

y(0) = y(1) =0, (5.8) 

where f € L7(0, 1]. Integrating Equation (5.7) 
y(z) = y(0) - i " f(s) ds (5.9) 
vc) = y(0)+avo) - ff He)asat (5.10) 

From the boundary conditions (5.8) we obtain 
s@) =-[° [ Ho)asatte f [ioyasat (5.11) 


Interchanging the order of integration in (5.11) 


y(z) -[ [rote ff so)atas 
[c — #) f(s) ds + i t(1—s)f(s) ds 
i s(1 — 2) f(s) ds + ii x(1—s)f(s)ds (x) 


= [ oxs)f(s)ds 
(Kf\(2) 


where the symmetric L?-kernel k, called the Green’s function is defined by 


i 


ee _jJsQl-sz) 0<s<e 
2 Paes Oi =3 az<s<l 
Conversely if f € L*[0,1] and y = Kf then y satisfies (5.7) and (5.8). Equation (5.8) 
is immediate. For (5.7) we need the Fundamental Theorem of Calculus for Lebesgue 


integrals. This is discussed in Weir §3.5. 


Theorem 5.5.4 Jf f € L*[0,1] and F(x) = fo f(s) ds then F is differentiable almost 
everywhere and F(x) = f(x) a.e.. 


Since y = Kf satisfies (5.11) we may differentiate to obtain 


v(e) = —f ss)ast [ f Hlo)as 
ye) = -< f[ fle)ds= fle) ae. 
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Let 
Di = ty € C[0, 1] : y(0) = y(1) = 0 and y"(x) = f(s) ae for some f € L?(0, 1]}, 


and define a linear operator A : D, > L*[0,1] by the formula Ay = —y”. Then A 
is surjective and kerA = {0}. Therefore A : D, — L?[0,1] is a bijection with inverse 
Kk. By Theorem 5.5.2 K compact self-adjoint, with ker(K) = {0}. By Theorem 5.4.11 
L?(0, 1] has an orthonormal basis consisting of the eigenvectors of K. These are precisely 
the normalised eigenvectors of A which we may obtain from the theory of ordinary 
differential equations. 


The eigenvalues of the equations 
y’ +rAy = 0,7 with boundary conditions y(0) = y(1) =0 


are {\ = n?x?:n =1,2,...} with eigenvectors {\V/2sinnrz:n=1,2,.. .}. By Theorem 
5.4.5 this is a complete orthonormal system for L7[0,1]. Thus in some cases L?-kernels 
can be used to prove completeness of some orthonormal systems. 


Exercise 5.5.5 


By changing the boundary condition to y(0) = y(1) = 1 show that {1,. /2cosnrx:n= 
1,2,...} is a complete orthonormal sequence for L*[—1, 1]. 


Deduce that {1//2,cosnmz, sinnrz : n = 1,2,...} is a complete orthonormal 
system for L?[—1,1] and by change of variables prove Corollary 4.1.19. 


Exercise 5.5.6 


Find the Green’s function, eigenvalues and eigenvectors for the operator A when the 
boundary conditions are y(0) = y/(1) = 0. 


For most practical purposes and in most examination questions the very general Fun- 
damental Theorem of Calculus, Theorem 5.5.4, is not needed since the eigenfunctions 
are automatically continuously differentiable. 


Exercise 5.5.7 Finals ’88, Q8, ’89, Q8, ’90, Q8, 791, Q8. 
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Chapter 6 


Finals Problems and Solutions 


6.1 1988 


In an examination the following solutions would need a little fleshing out. Standard 
results from Section A which are used should be referred to but need not be quoted in 
detail. It is however important to verify that necessary conditions for their validity are 
satisfied. . 


Any references to results in the text of these notes should be written out in detail. 


Q1. Let X be a normed vector space. A series 7°2, 2,, where z, € X for all n 
is said to be absolutely convergent if S>°°, ||zn|| converges. Show that X is a complete 
normed vector space (i.e. a Banach space) if and only if every absolutely convergent 
convergent series of elements of X is convergent in X. 


Now suppose that X is a Banach space and that T : X — X is a continuous linear 
operator such that for each y € X there exists X € X satisfying ||tX — Y|| < |lyl| 
and ||z|| < @|ly||, where a, B are real constants (independent of x and y) anda < 1. 


Show that for each y € X the equation Tz = y admits a solution x € X such that 
llzll < s2ollyll- 


1~a 


Solution. The first part is dealt with in Theorem 1.2.9. 


We use a contraction mapping argument constructing inductively a sequence (z,) C 
X converging to a solution. Suppose that zo, 21,...,¢2, € X with ||Tzro + Tx, +... + 
Tr, — y|| < at" ly] and ||z;|| < Ba'l|ly|| for i = 0,1,...,n. Then there exist rn41 € X 
such that 


[Tene —(y—T2o+Tr+...+T2,) || <ally—T2o +r +...4+T zal < a" |Iyll. 


llzntall S$ Bly -— Tro + Ta, +...+T2,|| < Ba"*" [yl]. 


When n = 0 such an zp € X exists, so, by induction, such an infinite sequence (tn) 
exists in X. 
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Now >>, |[tal| < (1—a)7 and &,, z, is absolutely convergent. Therefore there exists 
e GX such that 5°, @. = a 


If s, = 309 2% then lim,_,. 8, = z. Since T is continuous lim,_,,, Ts, = Tz. But 
[L'sn = y|| < a**|[y|| and lim, Ts, = y. Therefore Tx = y. 


Q2. (i) Let X be a complex normed vector space and let f be a continuous linear 
functional on X. Show that if a € X with f(a) £0 then each x € X admits a unique 
decomposition 


z=tat+y 


with t € C and y € ker(f). Hence or otherwise show that, if also ||a|| = 1, then the 
following are equivalent: 


(a) [F(@)| = IF lls 
(b)|]a + y|| > 1 for all y € ker(f); 
(c)||ta + y|| = |é| for all y € ker(f) and te C. 


(ii)Now let X be the (complex) space co consisting of all sequences 


& (Cage, Cape idy Cpe) 


of complex numbers £, such that limp.o&, = 0, endowed with the norm lols | 
8UPn>1|En|. Let f : X — C be defined by 


fe)= 2. 


n=1 


Show that if u € X and f(x) #0 then it is impossible to find v € ker(f) such that 
[u + v|] = inf{||x + yl] : y € ker(f)}. 


Solution. lft = f(x)/f(a) then f(x) =tf(a). If y = c—ta then f(y) = f(x)—tf(a) =0 
and « = ta+y wheret € C andy € ker(f). If z = t'a+y’ is another such decomposition 
then (t — t')a = y' — y € ker(f). Therefore (t — t') f(a) = 0 so that t = t’ and y = y’. 
Therefore the decomposition is unique. 


(a)—+(b). Suppose |f(a)| = || f || and y € ker(f). Then 
f(a + y)l = MFI S FIle + yl 


and |ja + yl| > 1. 
(b)—(c). Since [é|||a + y/t|| = [ta + y|| = |¢| whenever y € ker(f) and t € C. 


(c)—+(a). Since 


ane BONS axe lita + v)| 
z#0 Il=|| {yéker(f), t€C, ta+y#0} l|ta + y|| 
The dual of co is isomorphic to [' and ||f|| = D7? 2-" = 1. Let a = (a1, a2,...) € co 
with |[a|| = sup |a,| = 1. If f(a) = a, /2” = 1 then 1 < DJa,|/2" < 327" = 1 with 
equality if and only if a, = 1 for all n. In this case a ¢ co. It follows that there does 
not exist a € co satisfying (a)-(c) in (2). 


< |f(a)| < [lll 


ye, 


Let v € ker(f). 


|e + v|| = inf{|]u + y|| : y € ker(f)} if and only if 


l= ntl poy + yll: y € ker(f)} 


Since (b)—>(a) in (7) it follows that f (<**) = ||f|| which is a contradiction. 
utv 


Q3. Let H be a Hilbert space. Given z,y € H, show that 


(zy) = [lel Hyll 


if and only if z,y are linearly dependent. 


Let 1: H — H be a continuous linear operator such that ||T|]| <1, and let T* : 
H — H be the adjoint operator. Let 


Lo = {een sTe= ae}, 
iy = {ee Hi T* c= 2}, 
R = {c-Tx:2€ H} 
(i) Show that if x € L then ||T*z|| = |Iz||. 
(ii) Hence or otherwise prove that L C L, and deduce that L = Ij. 


(iii) Show that the orthogonal complement of R is L, and deduce that H is the 
orthogonal direct sum 


H=L9@M, 
where M is the closure of R. 


(iv) For all n > 1 let 


1 
T, =——(I+ T+#?4+...4+7"). 
aq rite bere) 


Show that if t,9R then T,z — 0 as n > oo. Hence show that for all z € X, T,z — Pr 
as n — oo, where P is the orthogonal projection of H onto L. 


[You may assume without proof that if E is a vector subspace of H then (E+)* is 
equal to the closure of E.] 


Solution. Assume z # 0 and @ = arg(z,y). Then for alla eR 
0 < lle“Pax + yl? = a?||x|] + 2al{x, y)| + [lyll? 


with equality for some a if and only if x and y are linearly dependent. This is true if 
and only if |(z,y)| = ||=|| |lyll- 
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Recall that 


|T]] = sup{|(Tz, y)|:2,y € H with |l<|] = |ly||} 


sup{|(z,T*y)| :2,y € H with |le|] = |lyl]} = ||T*|- 
Note also that ZL = ker(I — T) and L, = ker(I — T*) are closed subspaces of H. 
(i) If ¢ € L then 
llell? = [lx|| |Z" = (T*2, 2) = (2, Te) = |lel|? (x) 
which is true if and only if ||T*2|| = |Jz\|. 


II 


(ii) If « € L it follows from (x) that T*x = az for some a € C. Then 
lle||? = (x, t2) = (T* a, 2) = allel)? 
and a= 1. Therefore LZ € Ly. Since (T*)* = T it follows that Ly C L and L = Ly. 
(iii) If x € LZ then (y — Ty, z) = (y,(I— T*)z) = 0 for all y € H and RC Lt. since 


L is closed (Z*+)* = LC Rt. If x € Rt then (2, (I — tiie = ss —T*z,y) = 0 for all 
y © H. Therefore x € ZL} = L and R+ C L. Therefore R+ = 


Since R+ = L is closed it follows from the Projection Theorem, Theorem 3.3. 13, 
H=R'@(R')=LOM 
where M is the closure of R. 
(iv) Ife =y—Ty € R then 
[Tz] = ly- Tye +1) <= ITI ly/(m +1) +0 asn— ov. 


By the triangle inequality ||T7;,|| < 1. If X' € M and « > 0 then there exists ¢ € R 
such that ||¢ — 2’|| < « and N = N, such that ||T,2|| < ¢ whenever N > N. By the 
triangle inequality ||T,,2'|| < ||T,2|| + ||Z,2’ — T,2|| < 2e whenever n > N. Therefore 
limp soo Inz’ = 0. If € Lthen T,2 = z. Ife € H then ¢g = Px+z2’ where 2’ € M and 
T,« = T,(Px)+T,2' — Px asn— oo. 


Q4. Explain what is meant by the spectrum and spectral radius of a bounded linear 
- operator on a complex Banach space. State without proof the spectral radius formula 
for such operators. 


Let é? be the space of all complex sequences t = (€:)n>1 such that 7° |é,|? is 
convergent endowed with the usual inner product. The operators A,B,C: 2 — £? are 
defined by 

Ar = (€2,&3,4,-. aE 


Be = (&, 29,4... ne ey, 
Cr = 0,1, , &, &,.. .) 


Show that all three operators are bounded, and for each of them determine (i) its set 
of eigenvalues, (ii) its spectrum. 
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Solution. Let T be a bounded linear operator in a complex Banach space X. The 
spectrum of T is o(f) = {A € C : \I — T does not have a bounded inverse. The 
spectrum is a non-empty closed bounded subset of C and the spectral radius R(T) 
is the radius of the smallest disc centre 0 which contains o(T'). The spectral radius 
formula is 

Pell \== lim 1 die 


lL—0CO 


Since 7 a 
|Azl|? = So EP? < So UE)? < |Iz]]?. 
2 1 


2. 
S |lel|’ 


Loe} 


|| Bel] = ||Czl| = d7 


1 


bn 


A, B,C are bounded all with norm < 1. 


Let ef) = (6™) € €?. Then ||Ae)|| = 1 = |le|| and ||Be™|| = ||Ce™]] = 1 = Ife |] 
and |All = sup{fAc| : 2 € H and |jal| =1} =1= [|B] = ICI. 


If x is a eigenvector of A with eigenvalue \ € C then &,4; = X€, for n =1,2,... and 
&, = A". Then |[z|]? = [| oP |Al2 < 00 and |A| < 1. Conversely if |A] < 1 then 
(1, A, A?,...) is an eigenvector corresponding to \. Therefore the set of eigenvalues of A 
is the disc {A € C: |A| < 1}. 


If x is a eigenvector of B with eigenvalue \ € C then €,/n = XE, for n = 1,2,.... 
It follows that the set of eigenvalues is {1/n : n € N} with corresponding eigenvectors 
{el : nN}. 


If x is a eigenvector of C with eigenvalue \ € C then Af, = 0 and €,/n = A€na1 for 
n =1,2,.... It follows that the only eigenvalue is 0 with corresponding eigenvector «“), 


By Corollary 5.2.7 the spectrum of a bounded linear operator T is a non-empty 
closed subset of {A € C: [A] <r,(T)} C {A EC: A] < ||TI]}. 


The closure of the set of eigenvalues of A is {A € C: |A| < ||T|]} so that o(A) = 
{AE C: A] <||TI[}. 


Define a sequence of finite rank compact operators (B,,) by 
bo &3 b4 a 
Biel et ee i Ba 
. ( a ae Sa ear 


Then ||(B, — B)z|| < ||x||/n and B is the limit in the operator norm of compact op- 
erators. By Theorem 5.4.5 B is compact. By Corollary 5.4.12 the spectrum of B is 
{0,1,1/2,1/3,...,1/n,...} the closure of the set of eigenvalues. 


Iona = 30 (G@e a) te? < asl 


Therefore r,(C) = limp oo ||C"||!/" = lim,_...(n!)"/" = 0 and o(C) = {0}. 
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Q5. Suppose that 0 < a < a and that f : [—7,7] — R is defined by 


i(m —a)zx (QO<a<a) 
f(x) = ¢ fa(m - 2) (a= os) 
—f(-2) (-7 <x <0). 


Show that f has the Fourier series 


“1, : 
— sinnasinne. 


n=1 
Hence or otherwise show that 
fi om 
(2m + 1)? — 8 


m=0 


and evaluate Be 
>> 72m+1)* and > a 
m=0 n=1 nm 
[You should state clearly any standard theorems about Fourier series that you use, 
but are not required to prove them.] 


Solution. 
3 (a —a)z whenever0<2<a 


f(z) = 4 ta(m—a) whenevera<a<r 
—f(—z) whenever —17 <z <0 


where a € (0,7). Then f is a continuous odd function on[{—7, x]. The Fourier coefficients 
are a, = 0 and 


1 fo 7 
b, = - { (w-a)rsinne de += [ a(m — x) sinna dz 
m Jo T Jo 


w—-af 1 Ts a 
= ——xrcosnz = — sinng 
vis nr nr 0 
afl 1. i 
+— |-—(% — 2) cosnz — —sinnz 
us n n a 
= —sinna. 
n 


and the Fourier series for f is 
cas 
>> —rsinnasinns. 
a 
1 


Since f is continuous periodic and piecewise differentiable the Fourier series converges 
to f(x) for each x € [—7,7] If a = 7/2 then 


f(x/2) = Y Omar 5 


83 


By Parseval’s identity 


T= [" f@a- 
Cay eee ee 
96 J» 2+ (8m + 1) 
aie | sd 1 1 
m= L Gm t Gms 
and 
Sea | 16 1 n° 


“nt 15(2m—1)' 90 


Q6. Let €° be the Banach space of all bounded real sequences 


x = (1, &2, €3,..-) 
with norm defined by 
[|x|] = sup |g]. 
n>1 
Let T : £° — £* be defined by 
Tx = (2, €3, €4,---) 
and let e be the vector 
(Gt eee Pee 
Show that e is unit distance from 
M={¢t#-Tr:2 € £°}. 
Hence show there exists a continuous linear functional y on £© such that 
(i) ell = ee) = 1, 
(ii) (Lz) =z) (e € £*). 


Now suppose that a = (a,) € &” is such that limp..o@n exists. Deduce from (i) 
and (ii) that 


g(a) = lim a,. 


[Standard consequences of the Hahn—Banach Theorem may be used without proof 
if they are clearly stated.] 


Solution. T : £° — €© is the left shift 


T(E) = T (Cis baye-nsbnos) = (Castres 
¢ is the vector (1,1,1,...,1,...). 


Now ||T€]| < |lé|| aad val <1. Therefore T is continuous and M = Im(I —T). If 
d(e,M) <1 then 


lf — TE — el] = sup [E41 -G-W =n <1 
for some € € €*°. This implies 


a ae ese eS et i ree 
so that €; + oo as 1 — oo and € ¢ £™. Since |le|| = 1 it follows that d(e, M) = 1. 


84 


Define $9 € (M,e)* by the formula 


do(y + Ae) =A ye M, X\ER. 

Then 
[go(y + Ae)] < [Allly/A + ell = lly + Ael| OFAER 
and ¢o(e) = 1. Therefore ||¢o|| = 1, and ¢|M = 0. By the Hahn-Banach theorem ¢o 


has a norm preserving extension ¢ € (£°)*. 


Therefore ¢(€) = 6(T€) = ¢(1'€) for all n € N whenever € € €”. 


Suppose a = (a,) € I™ is such that L = lim,_,.. exists. Then given € > 0 there 
exists N = N, such that |a, — L| < € and therefore ||Le — T"a|| < ¢ whenever n > N. 
Therefore |¢(Le — T"a)| = |L — ¢(a)| < €, and 


6a) = Jim, a9 
Q3. Let H be a Hilbert space. Given x,y € H, show that 


(z,¥)| = [lel] Ilyll 


if and only if z, y are linearly dependent. 


Let T : H — H be a continuous linear operator such that ||T'| < 1, and let T* : 
H — H be the adjoint operator. Let 


E:. & ARCH VT =e}, 
I, = {f€H:T*z =z}, 
R = {t—Tzx:2€ H} 


(i) Show that if « € L then ||T*2|| = |{z]. 
(ii) Hence or otherwise prove that L C Ly and deduce that L = Ly. 


(iii) Show that the orthogonal complement of R is L, and deduce that H is the 
orthogonal direct sum 


H=L@M, 
where M is the closure of R. 
(iv) For all n > 1 let 
1 
T, = ——(I14+ T+# 4+... wy, 
ar, +7T7+#+4...4+7") 


Show that if z,5R then T,2 — 0 as n — oo. Hence show that for all z € X, T,x — Pr 
as n — oo, where P is the orthogonal projection of H onto L. 


[You may assume without proof that if E is a vector subspace of H then (E*)* is 
equal to the closure of E.] Q7. For each integer n > 0 let y, : R — R be defined by 


y(t) = (—1)"e"? (=) et, 


Show that y, € L?(R) and that the sequence (7,) wher pp = Yn/||¢nl| is orthonormal. 
Show further that for each n the function e”/ 20b,(t) is a polynomial in t of degree n. 
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Now suppose that f € L?(R) and that 


(f5%n) =0 (p20, 12s.) 


Prove that af 
i f(t)t"e PP? dt=0 (n=0,1,2,...) 


and deduce that, for each z € R, 
a f(the-*e7"/? dt = 0. 
Hence conclude that (%,)n>0 is a complete orthonormal sequence for D?(R). 


[You may assume without proof thet if g € L1(R) with f° g(t)e~“* dz = 0 for all 
xz ER then g(t) = 0 for almost all ¢.] 
Solution. By induction e*’/ *o,(t) = H,(t) is a polynomial of degree n, the nth Hermite 
polynomial. H,, cannot be in the linear span of Ho,..., H,,_1 so the Hermite polynomials 
are linearly independent. Since the linear span I[s[1,t,t?,...,t”] has dimension n + 1 
and contains Ln41 = 's[Ho, Hi, H2,..., H,| it follows that t” € L,41. Therefore 

cP 4" € Islyo(t),--., Pn(t)] 

and f f(t)t™e”/? dt = 0 for alln EN. 

Using Taylor’s theorem with remainder on the real and imaginary parts 


i (2223) 
a n! 


nes (ate) e 


ett = 
ae 


for allt,x €R andne€N. Therefore 


Se ul, 


ni 


a 
IA 
[8 
=| 9, 
uu 
eee 
~*~ 
i} 
~ 
* 
% 
= 


= I eid tin 


2"(n!)? 


which tends to zero as n — oo. In other words 


n—-1 t . 
Sn(t, t)= > (2 «)* ent /2 ak ev ite .—t?/2 


n! 


in L?(R) for each z ER. 
From above f f(t)s,(t, x) dt = 0 for all z and by the continuity of the inner product 


[ f@ee*r dt = 0 for each z € R. 


We may assume that f (t)e"?/ ? = 0 for almost all ¢ so that f = 0 almost everywhere. 
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Q8. Let H be the complex Hilbert space L?(0,1] with the usual inner product and 
let A: H — H be the operator (which you may assume without proof to be compact 


and self-adjoint) defined by 


(AAs) = als, 1) f(0) a, 


where a(s,t) = min(s,t)—st. Show that the eigenvectors of A associated with non-zero 
eigenvalues are continuous functions on [0,1] that vanish at both end-points. Hence find 
all the non-zero eigenvalues and their associated eigenvectors. 


Find ||Al|, stating clearly any theorems that you use. 


Solution. The L?-kernel a(s,t) = min(s,t)— st defines the compact self-adjoint operator 
A€ B(1?(0, 1) 


(f(s) = [as,os@at= [Ca-syr@art ['sa-Hrwae 


For all f € L?[0,1] the function (Af)(s) is continuous. If Af = Af and A £ 0 then f 
is continuous a.e. and so may be assumed continuous. It is immediate from (*) that 


(Af)(0) = (Af)(1) = 0, and f(0) = f(1) = 0. 
If y = Af then differentiating (*) twice gives 


y"(s) + f(s) = y"(s) + y(s)/A = 0. 
This has solutions 
y(s) = ecos(s/X) + bsin(s/X). 


From the boundary conditions c = 0, the eigenvalues are {2/(2n + 1)m : n € Z} with 
corresponding eigenvectors {sin(2n+1)m/2:n € Z}. Then || Al] = sup{|A| : A € o(A)} = 
2/t. 
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6.2 1989 


Ql. We say that a function f from a normed vector space X to the set R of real 
numbers is a Lipschitz function if there is a constant C such that 


lf(z) — Fy) < |lz — yl for all z,y € X. (1) 


We write A(X) for the set of all Lipschitz functions f on X which satisfy f(0) = 0. For 
f in A((X) we define A(f) to be the smallest constant C such that (1) holds. [You may 
assume that such a smallest constant exists.] 


(i) Prove that A(X) is a vector space over R and that || f|| = \(f) defines a norm on 
A(X). 


(ii) Prove that if f € A(X) and x € X then |f(z)| < A(f)IlaI. 


(iii) Prove that if (g,) is a Cauchy sequence in A(X) then, for every x € X, (g,(zx)) 
is a convergent sequence of real numbers. 


(iv) Prove that A(X) is a Banach space. 


Solution. 


lof(z) + B(x) — (a f(y) + Bo(y))| < lel |F(e) — FY) + IBII9() — oy) 
S (lelA(f) + 1|A(g))Il2 — yl], for allz,y € X, 
and af + Bg € A with \(f +9) < A(f) + Ag). Also 
Mof) =inf{le|C : la f(x) — af(y)| < le|Cl]z — yl]} 
= Jalinf{C : |f(x) — F(y)| < Cllz — yl|} = lelACA), 
and A is a norm. 


(ii) [F(@) — F(0)| = LF(@)| < ACF) lx for all « € X. 


(iii) If (g,) is a Cauchy sequence in A and € > 0 then there exists N = N, € N such 
that A(gn — Im) < € whenever m,n > N. Therefore 


lgn(X) — gm(2)| < A(gn — Gm)||2\| < elf] whenever z € X. (6.1) 
It follows that (g,(x)) is a Cauchy sequence for all x € X. 
(iv) Let g : X — R be defined by g(x) = lim, ... 9n(z) for each « € R. Then g(0) = 0 


and 
1gn(x) — Im(t) — (9n(y¥) — Im(y)] S ACGn — Gm)||e — yl| < ellz — yl (6.2) 
whenever m,n > N and x,y € X. Letting m — oo gives 
lgn(z) — g(#) — (guy) — 9(y))Ill2 — yl S elle — yl] whenever n > N, 2,y € X. 


Thus g, —g € A with A(g, — g) < € whenever n > N. Therefore g € A with g = lim, gn, 
and A is a Banach space. 
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Q2. Let Y,Z be normed vector spaces and let T: Y — Z be a linear mapping. 
Show that T is continuous if and only if T is bounded. Define the norm of such a linear 
mapping T. 


Let X be a normed vector space and let the Banach space A(X) be defined as in 
Question 1. [You may assume the results (i) and (ii) of that question.] Show that if f,h 
are in A(X) then so is the function J, f defined by 


(Ti f(x) = { fell*A(e) f(z) ife £0 


ifz=—0. 


Show that the mapping J, : A(X) — A(X) is linear and bounded with ||h|]| < ||TA|| < 
3[>l]. 


Solution. T is bounded if there exists c € [0,00) with ||T'x|| < el|z]] for all ce X. fT 
is bounded the norm of T is 


[Tl] = inf{e: ||Tz]] < ellx|| for all x € X} = sup{||T2|| : « € X with |[a|] = 1} 


If T is continuous then T is continuous at 0. Therefore there exists 6 > 0 such that 
|x|] < 1 whenever ||zx|| < 26. Therefore 


[r (ier) | <1. and ||Tz|| < allel for all x € X. 


If T is bounded then ||T'z|| < ||T'|| ||z|| for all c € X. Therefore ||Tz—Ty]| = |[T(z—y)|| < 
e whenever ||x — y|] < €/||Z'|| and T is (uniformly) continuous. | 


Let f,g€ Aanda,BeER. Then 


(Th(af + 8g))(z) = Pal Meer) + Bg(x)) nee) xr £0 
a(T,f)(z) + B(Trg)(x) for all x € X, 


and Tj, is linear. 


If c,y € X then 
(Di f)(2) — ThA) = Mell" h(@)F(2) — lull “AOFM 
= | [lel "A@)(F(e) — F(y)) + lel 7h FY) — lly AOFM 
S | lel" ACF (@) — FY) + (lle = Hy Dh@)F@)I + Hy *(h@) — AG) FO) 
S 2(A)ACF Ile — yll + ACA)ACA)I Mell — [ly | 


S 3A(h)ACF le — yl 
Therefore \(T;, f) < 3A(f)A(h) and ||Ti|| < 3]fAl]. 


89 


If f(x) = |[c|| for all c € X then f € A and Xf) = inf{C : ||z — y|| < Cllz — 
y|| for all z,y € X}=1. Now T,f =h so Ah) < ||Th||A(F) = ||TiI] and JAI] < |Z]. 


Q3. Let C be a non-empty closed convex subset of a real Hilbert space H. Prove 
that for all z € H there is a unique element x’ of C which satisfies 
|c — 2’ || = inf{||z — w]] : w € C}. 


By considering points of the form (1 — A)z’ + \z, or otherwise, show that z’ is charac- 
terised among points of C’ by the condition: 


for allx EC (2' —az,2'—z) <0. 


Now let y be another element of H and let y’ be the corresponding closest point in C. 
Show that ||x’ — y’||? < (x’ — y', 2 — y) and deduce that ||x’ — y’|| < la — y|]. 


Solution. Let d = inf{||z —y|| : y € C} and let (yn) € C be such that lim, ||z — y,|] = d. 
If z, = x — y, then by the parallelogram law (3.8) 


0S [lyn — Yall? = ll2n — 2mll? = 2 ([l2nll? + [l2mll?) — [len + 2mll? 
Yn + Ym 
= 2 (Ilzall? + [lemll?) — 4lle — 5" |? 


<2 (lznll? + l|2m lI?) — 4d, for allm,n EN, 


since }(%n + ym) lies in the convex set C. Since lim n—co || Zn||? + ||zm||? = 2d? it follows 
that (y,) is a Cauchy sequence in C converging to x’ € C. Moreover ||z — 2'|| = 
lim, ||Z|| = d. 


If x” € C with ||z” — c|| = d then put w =z — 2" and z= 2—2'. Now 
O< |x” — 2" ||? = lz — wl? = 2((lzl? + loll?) — [Jz + wll? 


gl! + q! 


2 


= 4d* —Allx — I? <0 
and z! = z”. Therefore x’ is unique. 
If A € [0,1] and z € C then (1— A)z' + Az E C. Now 
0< || —A)z' + Az — al)? — d? = |[(2’ — 2) — A(z’ — z)|P? -—@? 
= —2\2' —2z,2'—z)+ \*|\r’ — z|l? for all z EC. 
If x9 € C with (xo — t, 29 — z) < 0 for all z € C then for all z E C 
Ir — 2]? = lla — 20 + 20 — all? = flo — aol? + 2(0 — 20, 20 — 2) + Ilo — zl]? > lle — aol 


and x = zg. Therefore zx’ is characterised by the given condition. 
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Both 2’,y’ € C so (#' — 2,2’ — y’) <0 and (y’— y,y’ — 2’) < 0. Therefore 
02 (2! —2—(y'—y), 2’ —y) = (2 -y'— (@-y), 2’ -y') 
= |le’ —y'I? — (2! — ye ~y) 2 IIe" — 91? = lle’ — y'Il lle — 9 
Therefore ||x’ — y'||? < (x’ — y’,z — y) and ||x’ — y’|| < ||z — yl]. 


Q4. let H:R—R be the function defined by 


i ro<t<3 
A(t) =¢ -1 ee et 
Oo otherwise 


For m,n € Z let the function hy, be defined by Ainn(t) = 27"/h(2-"t — m). Show that 
(Am,n)mnez is an orthonormal system in L?(R). 


Let x be the indicator function y, of an interval I = (j2*,(j +1)2*], where j and k are 
integers. Show that (, hm) = 0 ifn < k and that, for each n > k, there is a unique m 
for which (2, hmn #0. By calculating 


3s 3 lohan)’. 


n=—infty m=—infty 
or otherwise, show that z is in the closed linear span of the functions h,,,,. Deduce that 
the orthonormal system (himn)mmnez is complete. 


Solution. For m,n € Z define unit vectors hm» € L?(R) by the formula 


2-7/2 if 2m <t < 2%(m+ 4) 
heiglt) = | —2-"/2 if 2m +4) <t< 2%(m+41) 

0 otherwise. | 
(a) fRmn =0 for all m,n | 
(b) For fixed n the supports of distinct hy, are disjoint so the hm,» are orthonormal. | 
(c) Ifk > n then h,,, is constant on supphm,» for all m’ and therefore orthogonal to | 


| 
Therefore {Rmn}m,nez is an orthogonal system. 


Let j,k € Z and let 25, = 1¢jok (;41)a4- If k =n there is exactly one j such that 
ja* < m2” < (m+ 1)2” < 52" 
Therefore (;,4, hmm) = for all j whenever k > n. 
If n > k there is exactly one m such that 
either m2” < 72° < (j +.1)2* < (m+ 4)2” 
or (m + $)2" < j2* < (7 +:1)2* < (m+1)2” 


For this m (23,4; mn) = +2-"/2 9k and for other m, zero. Therefore 


0° fore) oe) 
» >» (2 5,k> la): oe 3S at Ilzs,«l?. 
n=—0o M=—00 n=k+1 


By Parseval’s identity 23,4 = OP n=—co(Lj,ky bmn): 
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Let H and X be the closed linear span of the functions hm, and Xj, respectively. 
From above z;, € H for all j,k, and X C H. The set S of step functions with 
discontinuities at the dyadic rationals is dense in L?(R). But S is the linear span of the 


tj. Therefore X = H = L?(R) and the orthonormal system {hmn}m,nez is complete. 
QO 


Q5. (i) Let £° be the space of all bounded sequences of complex numbers 7 = 
(Mn nen, equipped with the norm ||7||.. = sup,cy|7n|- Let @ be the space of absolutely 
summable sequences € = (€,)nen equipped with the norm ||&||; = °°, |é,|. Prove that 
there is an isometric linear mapping from £* onto the dual space of ¢!, which associates 
with any 7 € £° the linear functional € > °°, nn. Give without proof an analogous 
description of the dual space of @?. 


(ii) Let A be a real number and, for each natural number m, let €") be the sequence 
(0,0,...,0,1,2A,1,0,0,...) 


with the entry —2A in position m+1. Let Y be the linear span of the set {€( : m € N}. 
For what values of \ is Y a dense subspace: (a) of £';(b) of €?? [Standard consequences 
of the Hahn—Banach Theorem and standard results about difference equations may be 
used without proof.] 


Solution. (i) The isometric isomorphism between (é')* and €° is proved in Example 
1.5.20). 


There is an isometric isomorphism from é? onto (£?)* which associates with any 
7 = (Nn)eo € &” the linear functional € + 29 fntin where € = (€,)% 5 C &?. 


n=0 


(ii) Suppose that Xo is a closed subspace of a normed vector space (X, || - ||) and 
that z, € X — Xo. Let X, be the linear span of X and 2; and define ¢ € Xf by 
$i(x + az,) = a for alla € C. Then Xo = ker(¢) is closed in X, so ¢, is bounded 
and by the Hahn-Banach Theorem has a norm-preserving extension to ¢ € X*. If L 
is a dense subspace of X then every wo € L* has a unique extension to » € X*. In 
particular if % = 0 then ~ = 0. it follows from the above remarks that a subspace L is 
not dense in X if and only there exists 0 4 ¢ € X* such that diz = 0. See Corollary 
2.2.6. 


(a) Suppose ¢ € (é")* with dy = 0. If ¢ is associated with n in £° then 
Mn — 2ANn+1 + M42 = 0 forsr 0512 ak (x) (6.3) 
This difference equation has characteristic polynomial 2? — 2\z + 1. 
Case 1. |A| > 1. The roots are real and one root p has |p| < 1 


Case 2. |A| <1 A #+1. Conjugate roots p and p with modulus 1. 


2 


Case 3. \ = £1. Double roots +1 


In Both cases , = mop” satisfies (x) and 7 = (1mm) € £°. The corresponding ¢ € (€1)* is 
non-zero and satisfies ¢jy = 0. Therefore Y is not dense for any \ € R. 


(b) Suppose ¢ € (¢7)* with dy = 0. If ¢ is associated with 7 in * then the n, must 
also satisfy (x). In case 1 put ny, = p” then > p?" < co and 7 € &’. It follows that Y is 
not dense in £?. 


In case 2 7, = ap” + bp” where a and 6 are arbitrary constants are the only solutions 
of (x). If 7 = (nn) € @ then yn, + 0 asn — co anda=b=0. Therefore ¢ = 0 and Y 


is dense in &?. 


In case 3 n, = a(F1)"(a + bn) and 7 = (m) € &? implies a = 6 = 0 and Yis dense in 


oo 


Q5. (i) Let € be the space of all bounded sequences of complex numbers 7 = 
(Nn )neN, equipped with the norm ||n||.. = supycp {yn|. Let £1 be the space of absolutely 
summable sequences € = (€;)nen equipped with the norm ||€|]1 = 37°29 |€n|. Prove that 
there is an isometric linear mapping from © onto the dual space of £1, which associates 
with any 7 € £° the linear functional > S7°°., nn. Give without proof an analogous 
description of the dual space of £?. 


(ii) Let \ be a real number and, for each natural number m, let €(”) be the sequence 
(0;0;.225051-91,1, 050,222) 


with the entry —2A in position m+1. Let Y be the linear span of the set {60 : m € N}. 
For what values of \ is Y a dense subspace: (a) of £1;(b) of €?? [Standard consequences 
of the Hahn—Banach Theorem and standard results about difference equations may be 
used without proof.] Q6 (i) Let X be a complex Banach space and let T: X — X 
be a bounded linear mapping. Define the spectrum of T and prove that it is a closed 
_ bounded subset of C. State without proof a formula for the spectral radius of T. 


(ii) Determine explicitly the spectrum of each of the following operators from [' to I". 
(a) S(£0, 1, €2,---) = (&1, £2, &3,..-)5 
(b) T(€o, 1, €2,...) = (€2 — 260, 3 — &1, €4 — 260, ...); 
(6) U(Gon€ts 22-3) = Crs bb, 2Esy--) 


Solution. The spectrum o(T) of T is {\ € C : AI — T has no bounded inverse . It is 
proved in Corollary 5.2.7 that o(T) is compact. 
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(a) The operator S: 1’ — [' is defined by the formula 


SE = S( fo, &1, &2, e8 5) = (61, &2, Es, ve ss 
Then [[S€l] = SP l&l < Do lé| = |[él], with equality if and only if & = 0. Therefore 
|| S| = 1. Simple calculation shows that (\ — S)€ = 0 if and only if €; = \*& for all 4. 
If |A| < 1 then S°9° |A"| = (1 — |A])7? so that the vector (1, A, \”,...) is an eigenvector 
with eigenvalue A. Therefore {A € C : |A] < 1} C o(S). The spectrum is a closed subset 
of {A : |A| < ||S|]} and therefore 
a(S p= Ws Al it 
- (b) Let T = S? — 21. Then 


T(€) = T (£0, 1, Eo, oa J aes (£2 7 260, E3 7 2&1, &4 == 26, oe :)s 


Let p(x) be the polynomial 2? — 2. By Theorem 5.2.11, the spectral mapping theorem 
for polynomials, o(T) = o(p(S)) = p(o(S)), the closed unit disk centre —2. 


(c) If U(€) = U(£o, fi, £2, we .) = (&1, 5o25 363, oe ) then 
WOM = Dheal/n < So léal = Hell 


and |[U|| <1. If & = 6: then ||U(€)|| = ||(€)|| and ||U|] = 1. 

Simple calculation shows that (A — U)€ = 0 if and only if €&, = nA" for all n > 0. 
If |A] < 1 then 9°nrA”" < oo and (1, A, 247, 3\3,...) is an eigenvector of U with 
eigenvalue A. Arguing as in (a) the spectrum of U is the closed unit disc. 


Q7. Let z be a real number with —7 < x < 7; define f, to be the indicator function 
X(0,2) if e > 0, and to be —yx(2,.9) if c < 0. Calculate the coefficients a,,(x), b,(x) in the 
Fourier series 


5A0(2) + 2(an(2) cos nt + b,(z) sin nt) 


of f,. By applying an appropriate theorem about pointwise convergence of Fourier 
series, evaluate the sum 


3 sinnz 
n=1 n 


For a finction g € L?(—,7), define G : (—1, 7) — C by 


G(e) = [ g(t) at 


(with the usual convention that fy g(t)dt = —fgx (co) if ¢ < 0). Prove that if the 


Fourier series of g is 
1 


500 + So(cn cosnt + d, sin nt) 


n>1 
then, for all « € (—7, 7), 
i eek 
Gc) = cot + >| —(c, sinnz + d,(1 — cosnz)). 
n=1 n 


Express the Fourier coefficients c,, D, of G in terms of c, and d,. 
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Solution. Let fre = 1,2) for 0< ¢ < m and let f, = 1(2,0) for —t < x < 0. The Fourier 
coefficients are 


1 L 
ao(x) = = dt = 


1 x 
aqtey= =f cos nt dt = 
m Jo 


sinnz 


g|-ais 


1 ff 1 
bale) = - | sin nt dt = ——— cosnz. 
m Jo nT 


By Dini’s test, Theorem 4.1.8, or by Theorem 4.1.12 since f, is piecewise continuously 
differentiable the Fourier series for f, converges to }(fc(t+) + fx(t—)) for each t € 
(—7,7). Therefore 


1 kaa | 
5 (fe(t+) + f,(t—)) = = + » ~ (sin nz cos nt — cos nz sin nt) 


CO 


Tipe +L gpsinnle —t). 


Putting t = 0 gives 


> 0 z=0 
1 t(c+nm) —-r™<z<0 


If g € L?(—7, 7) define G : (—1, 7) — C by 


Gla) = [ alt) dt = (9, fe). 


ae i(a—m) O<a<r 
rs = 


By Theorem 4.1.21 the Fourier series of g converges to g in L*-norm. Thus 
i! = : us. 
g(t) = 3° + ) (ec, cosnt + d, sinnt) in L*(—7, 7). 
1 
By the continuity of the inner product 


G(«z) = oot fr) + > (en(eos nt, f2(t)) + dn(sin nt, f,(t))) 


1 ae 
= cot + 55 =(c, sinnz + dy(1 — cosnz)). 
me 


Since (cos nt, f.(t)) = fo cosnt dt = +sinnz etc.. 


A simple calculation gives the Fourier series for z. 


co f__4\ntl1 
225 
1 


sin Nx convergent pointwise and in L?(—7, 7) 
n 
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Therefore, for each x € (—7,7), 
a Ot aa was 
G(x) = ¥> * + 5 =((en — =(-1)"c0) sin ne — dy cosnz) 
hie 7 2 


1 CO 
= 500 + }\(C, cosnz + D, sinnz) 
1 


Note here that the sequences {1/n}, {cn}, {d,} € 0? so that 0d, /n is convergent and 
the sequences {+(c, —(—1)")}, {4d,} are in @. The trigonometric functions are an 
orthonormal basis for L?(—z,7). Therefore, if G, is the nth partial sum of the series 
then ||G — Gall? = OBC? + |Dn|?) > 0 as n — oo. Thus the series converges 


to G in L?(—7,7) and the Fourier coefficients of G are Co = DP“ C, = —+d, and 
D, = Len — t(-1)"co. 


Q8. Let k be the indicator function of the set {(z,y): z,y € [0,1] andz +y> 1}. 
Consider the operator T : L?[0,1] + L?(0,1] defined by 


(THe) = [' Mx,y)iw) dy 


[You may assume without proof that this operator exists and is compact and self- 
adjoint.] 


We say that f is an eigenfunction of T with eigenvalue A if Tf = \f and f is not almost 
everywhere zero. prove that if this is th case then f is differentiable on (0,1) with 


Afi(z) = f(l—2). 


[You may assume that 0 is not an eigenvalue of T.] Hence show that there are constants 
a, 6 such that 


f(x) = acos(a/X) + bsin(x/d) (0-< 2 <1). 
Find all the eigenvalues of T and hence calculate ||T'||. 


Solution. If k is the indicator function of {(x,y):z,y € [0,1] and x+y > 1} then 


(TANe)= [ Me,v)iyay= f° fu)ay, 


whenever f € L*(0,1] defines a compact self-adjoint operator. 


If Tf = rf then f € L[0,1] agrees with the continuous function Tf almost every- 
where, and so may be chosen continuous. Since f is continuous (f/_, f(y) dy) = f(1—z) 
so that 


Af'(z) = f(l— 2) 
This gives 


MN f"(z) = —f(z) with boundary conditions f(0) = f’(1) =0 
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The general solution of this differential equation is 
f(x) = acos(z/X) + bsin(z/A) 


The boundary conditions imply a = 0 and cos(1/A) = 0. The possible solutions are 
eigenfunctions {sin(n + })ra : n € Z} with corresponding eigenvalues {1/(n + L)rine€ 
Z}. It may be verified that these are indeed the eigenfunctions and eigenvalues. 

Since Tis compact it follows from Corollary 5.4.10 that 


[Z| = max{]A| : \ is an eigenvalue of T} = 2/z. 
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6.3 1990 


Q1 Let B be the space of all bounded real-valued functions on the interval [0,1]. For 
f € B define |||. = supzeo; |f(t)|. Show that || - ||. is a norm on B under which B 
is a Banach space. 


We say that a bounded real-valued function f on [0,1] is regulated if the left limit 
f(x—) exists for all z € (0,1] and the right limit f(@-+) exists for all z € [0,1).Prove 
that the subspace R of B which consists of all regulated functions is closed in B. Prove 
also that the step functions on [0,1] form a dense subspace of R. 


[You may assume that any covering of [0,1] by open intervals admits a finite subcover- 
ing.] 

Solution. If f,g € B and a,f € R it is immediate that af + Bg € B so that Bisa 
vector space. 

(DE file = suPpe(o,1) |f(t)| = 0, then f = 0. 

(2) llaflloo = suprepo,y loll f(4)| = lel fllco- 


(3) If + 9) S IFO) + Ig) S Wf lloo + IIglloo for all ¢ € [0,1] and ||f + glo < 
Il Flloo + [Igloo 


Thus || - ||. is a norm on B. 


Let (fn) be a Cauchy sequence in (B,||-||..). If € > 0 there exists N = N. € N such 
that 


[fn(t) — fm(#)| < Ilfx — fmlloo <€ for allt € [0,1]. (x) 


Therefore (f,(t)) is a Cauchy sequence for each ¢t € [0,1]. Since R is complete there 
exists f : [0,1] > R such that f(t) = lim, f,(t) for all ¢ € [0,1]. 


Letting n — oo in («) it follows that |f,(t) — f(t)| < € for all n > N and all t. 
Therefore f, — f € B, f € B, and lim, ||f, — f\l. = 0. Therefore B is complete: a 
Banach space. 


Suppose the sequence (f,) C R. If to € [0,1) then there exists § = 5y such that 
|fn(t) — f(s)| < € whenever ty < s,t < tp + 6. Therefore 


lf(s) — f(t) = |F(s) — f(s) + fv(s) — f(t) + Frv(t) — FO) 
< |f(s) — f(s) + |fn(s) — fr(®)| + |fv(t) — F(D)| < 3e 


whenever tp < s,t < to + 6. This is the Cauchy condition for f to have a right limit at 
to. A similar argument shows that f has left limits, so that f is regulated. 
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Suppose that 0 < f € R. Ift € [0,1] there exists 6; > 0 such that 
\f(x) — f(y)| <¢€ whenever z,y € [0,1] witht -6,<2,y<tort<2,y<t+é 


Let I, = (t-6:,¢+ 6), Je = (t—6:,t),; Ki = (t,t +6:). The open cover (J;)z¢f0,1] of [0, 1] 
has a finite subcover J;,,...,1;,. Choose € € Jz, and n, € Ky, and put 


bx = F(E)la, + f(me)le, + F(te)1y,- 


Since f > 0 it follows that max{¢,(t),...,¢n(¢)} — f()| < ¢ for all t € [0,1]. Since 
the function max{¢1,...,¢n} € L*°? it follows that f can be approximated in I - loo by 
functions in L*?, This remains true for any g € R since 0 < g — ||g||,. € R. Therefore 
L**©? is || - ||..-dense in R. 


Q2 State the Riesz Representation Theorem for continuous linear functionals on a 
real Hilbert space X. 

Let H be a real Hilbert space and let X be a closed linear subspace of H. Prove 
that for each element u of H there is a unique element x, of X with the property that 


(tu,z) =(u,z) forall ze X. 


Show that |]u||? = ||v.||? + |lu — z.|]? and that the mapping Py : u +> a, is a linear 
projection of H onto X. 

Now let Y be another closed linear subspace of H and let v be any element of H. 
Consider the sequence (v,,) defined recursively by 


Vo =v, Von = Px Von, > Van+2 = Py von4i . 


Show that if z isin X NY then 


(Un, z) = (v, z) 


for all n. Show also that if m,n are natural numbers and m <n then 
n-1 
Penall? — onll? = > ley — val. 
j=m 


Deduce that if a subsequence of (v,) converges then its limit can only be Pynpyv. 


Solution. Riesz Representation Theorem. Let H be a real Hilbert space. For each 
f € H* there exists a unique j(f) € H such that 


Gar 73) whenever x € H. 


The map j : f > j(f) ts an tsometric isomorphism of H* onto H. 
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Ifu € H define the functional f, by f(z) = (u, z) whenever z € X. By the Cauchy-— 
Schwarz Inequality |fu(z)| < |lul| ||z|| and f. ¢ X*. If 7(f.) = cz, then 2, is the unique 
vector in X such that 


(fase) = tae) for all z € X. 
Now (#;.2u) = (20, £2) ='|\2a|? sovthat 
Ju — tall? = (u ~ ty, u — ty) = [ful]? + [leu]? — 2(u, 24) = [lal]? = foul? 


as required. 
Now let Px(u) = X, for 2 € H. Ifu,v € H, z € X, anda,f ER then 
(Canov = (au + Bv,2) = a(u,2) + Blv,2) = (ata + Bas, 2) 
and Zeutgu = AL, + Pry. Therefore Py is linear. 


Since ((%u)u,2) = (Lu, Zz) = (u, 2) for all z € X it follows that P?(u) = (x,y), =a, = 
Px(u) and Py is a projection. 


IfzEe XY then 
(Van+41 2) = (Px v2n1, 2) = (van, 2) - (Py Van-1, 2) = (Von—1, 2) SS... (vo, Z). 


It follows from above that 


n-1 n-1 
l]omll? = [onl]? = So (lesll? — [loveall? = 90 Iles — essa ll? 
m m : 


If the subsequence vp, converges then ||v,,|| converges by continuity of the norm. If 
€ > 0 then there exists K = K, such that ||v,, — w|| <> and 


i-1 
[lem lI? ~ llencll? = 2 les — visall? < e?. 
k 


Therefore ||vn, — Un,+1|] < € and |lun,41 — wl] < 2e. 
(a) If vz, € X then Pxv,, = vp, and lon, Px || = ||[P(on, — w)|| < jon, — wll <e. 
(b) Ifv,, € Y then Pxyvn, = vp, 41 and lUnpt1—Pew|| = ||P(vn,—-w)|| < |lvn, -w| < €. 


In each case the triangle inequality implies that ||Pxw — w|| < 3e. It follows that 
Pxyw=wandw€X. Similarly w€ Y andwe Xny. 
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Moreover w = Pynyv since 
(oj 2)= lim (vn, » 2) AU, 2) = Peay v2); whenever z € XNY. 


Q3 State the Hahn—Banach theorem concerning the extension of a continuous linear 
functional from a subspace of a real normed space to the whole of that space. 

Let X be a real normed space and let ro be an element of X with ||zo|| = 1. Prove 
that there exists an element f of the dual space X* with ||f|] = f(zo) = 1. 

Let yo be an element of X which is not linearly dependent upon zo and let Y be the 
subspace of X spanned by the two vectors zp and yo. Define functions ¢, 7% :R — R by 
$(s) = s—|[szo — yoll 
P(t) = |ltro + yoll — t. 


Prove that ¢ is an increasing function, that ~ is decreasing and that ¢(s) < (t) for all 
s,t. Show that the formula 

GAxo + Yo) = A+ HY 
defines a linear functional of norm 1 on Y if and only if lim,_,.. 6(s) < y < lim: Y(t). 
Show further that there is a unique linear functional g on Y satisfying ||g|| = g(xo) = 1 
if and only if the function 

ut ||zo + uyol|: RR 


is differentiable at 0. 
Show finally that there is a unique element f of X* with ||f|| = f(zo) = 1 if and 
only if, for every y € X, the function 


ut |lzo + uy]: ROR 
is differentiable at 0. 


Solution. For paragraphs one and two see Theorem 2.2.1 and Corollary 2.2.3. 


The next part follows a proof of the Hahn—-Banach Theorem. By the triangle in- 
equality 


Ils%0 — yoll < [I(s ~ t)zol] + ||txo — yol] = (s — #)||zol| + [lo — yol| 

whenever s > t, and ¢ is increasing. By symmetry, # is decreasing. Since ~ 
(s +t) = (s +2)llxol] < |s + ¢]llxoll < I]s%0 — yol| + []txo + yol| 
it follows that ¢(s) < w(t) for all s, t. Therefore 
dm ¢(s)="1 S72 = limp) (x) (6.4) 
Since $(s) < ¢(¢) for all s, ¢ it follows that 
g(sto—7) =8— 7S lst —yoll, gto + ¥0) = ¥+# S [Ito + voll 

for all s, t. By considering positive and negative p it is easy to see that for all A, we R 


Ig(Axo AP LYo)| < |Azo + LLYo|| 
and ||g|| = 1. 
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g is unique if and only if Y= 2 = 7 in (x). Putting s = 1/u and t = 1/v in (*), 
this is true if and only if 


: 1 a | 
lim —(1 —||zo — uyol|) = y = lim 5 (llzo + vyo|| + 1). (xx) (6.5) 


0<u0 Y 0<v-0 


(xx) holds if and only if the function u > O,,(u) = ||zo + uyol| is differentiable at 0 with 
derivative y. 


If ©, is differentiable at 0 for each y € X and f, g € X* satisfy f(xo) = g(ao) = 1 
then on Is[zo, y] we have f = g. Therefore f(y) = g(y) for all y € X and f is unique. 
Conversely if f(y) # g(y) for some y then O, is not differentiable at 0. 


Q4. Let co be the space of all sequences (€,) of complex numbers which satisfy 
E, — 0 as n — oo and let £" be the space of absolutely summable sequences (1n)nen 
of complex numbers. Let co and £* be be equiped with the norms ||€||.. = supjen |én| 
and ||n||1 = ¢° |nn| respectively. Prove that there is a linear isometry from ¢! onto the 
dual space (co)* of co, which associates with the sequence (nm) the functional (Em) 


yones Ena . 


Now let c be the space of all convergent sequences ov complex numbers, also equipped 
with the norm || - ||.., and let « denote the sequence all of whose terms are equal to 1. 
Show that each element ¢ of c has a unique representation ¢ = € + \z with € € cp and 
A’ € C. Hence or otherwise, show that there is a linear bijection from £' @ C onto the 
dual space c*, which associates with an element (1, 4) of the former space the functional 


[oe] 
6 Do tase + lim sy. 
n=0 


Find the norm of this functional in terms of py and the nn. 
Solution. The duality between cp and ¢! is covered in Example 1.5.19. 


Tf ¢ = (<,) € ¢ then put A = X(s) = lims,. Note that |A(s)] < |[|sl]0.- Put 
En = Sn—A(s) and € = (€,). Then € € cg and ¢ has the representation ¢ = +1. To show 
uniqueness suppose that ¢ = €'+ Xe with € € co and \’ € C. Then —2' = (A—-X’)e E co 
and A = \’. Therefor = é’ and the representation is unique. 


For (yn, 4) € £1 @C and ¢ €c put 
7, 


dnulS) = a MnSn + BL dim Sn 


Then s 
lPnul(S)ES D2 Insel = lHllAS)I < Isl Clells + Lal), 


n=0 


and $,, € ¢* with ||¢n,u|| < |ln|la+|u|. Moreover 7 = ¢,,,, restricted to cy and ¢,,,(t) = [- 
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If dnp = Oyu then byy(t) = oy w(t) and yw = pw’. Similarly the restrictions to co of 
bn, and ¢,,,: are equal and 7 = 7’. Therefore the map (7, 4) > ¢,,, form €' @ C is 1-1. 
It is easy to verify that the map is linear. 


Suppose ¢ € c* then there exists a unique 7 € @' such that $(€) = 3°, Mtn for all 
& Eco. If d(e) = pw then 


$(s) = 3 Mnén + UAE) for alls Ec. 


n=0 
and ¢ = ¢,,,- Therefore the map (7, 1) :— ¢,,, is a linear bijection from £1 4 € onto c*. 


Suppose (7,4) € 4’ ®C and e > 0. There exists N = N. such that 1% |n,| < e. 
Define ¢ € c by 


eis sgn(n), forn< WN, 
a sgn(u), forn > N. 


Then ||¢||.. = 1 and 


N-1 fore) 
Ibua() = Ss bal +sen(4) (So r 1) > [Kslleo( [lalla + Jul — 6). 


It follows that |[¢nu|l = |ln|li + lel. 


Q5 Let X be a complex Banach space and let D be a subset of X such that the 
linear span sp D is dense in X. For each natural number n, let T, : X — X bea 
bounded linear mapping. Suppose that ||y — T,y|| > 0 as n — oo, for all y € D, and 
that there is some positive real number M such that ||T;,|| < M for all n. Prove that 
lc — T,c|| > 0 as n— oo forall c € X. 


For a function f € L'(R) and a real number t we define Tf : R > C by (%if)(z) = 
f(x —t). Show that J; is a bounded linear mapping from L}(R) to itself and that 
\|Z;|| = 1. Show further that, for any f € L’, \||f —Tif|| > 0 as t > 0. [You may assume 
that the subspace consisting of all step functions is dense in L‘(R),] 

Prove that if f is in L'(R) and g is a bounded measurable function on R then we 
may define (everywhere) a function f *g:R— C by 

(Feat) = [fe —2)9(2) de 


and that f * g is continuous. 


Solution. If z € spD then z = St ajy; where a; € C, y; € D, andn € N and 
lz - T,z|| < So laillly:s — Trvill + 0 
1 


asn— oo. If eX and e> 0 there exists z € spD with ||z — z|| < «. By the triangle 
inequality 


lle — Tr2l| < [lz — Thz|| + llz — zl + [Tae - Tr2l| < llz - Thz|] ++ Me. 


Now there exists N = N,, such that for n > N we have ||z — T,,z|| < ¢ therefore 
lz — T.2|| < (M + 2)e and lim,_..g ||z — T,2|| = 0 
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The Lebesgue integral is translation invariant. Therefore T;f € L* and 


If =f T@)ldx = [fet de = f\F(2)) ax = [Fh 
and T; is bounded with norm 1. 


If D = {1;: I is a bounded real interval } then spD is dense in L. If y = 1a) € D 
then 


lx — Tixll < lel whenever |t| < b — a. 


Therefore || — T;,,x|| — 0 whenever t, — 0 as n — oo. It follows that if ¢ € L*? then 
lo — Ti, ¢|| + 0 whenever lim,_,..t, = 0. It follows from the first part of the question 
that limyo || f — Tif], = 0. 


Since T;f € L' and g is measurable bounded by M it follows that gT:f € L! so that 
f *g is everywhere defined. 


‘Now 


IF «a)(t) — (Fea) 1 =| [FE = 2) = Fle — 2)g(2) do 


< [\(L-D)Ala)g(2)l de = f (TUE - Te) f\(a)o(e)| ae 
= ||97 — Ts-+) fla < MZ — Ts-+) fll 


which converges to 0 with |t — s|. Therefore f « g is continuous. 


Q6 Let (w,) be a bounded sequence of non-zero complex numbers. Find the norm 
of the bounded linear operator T : £1 — £' defined by 


T(£o Gy ee ) = (wié1 , We2 , W363 ,-- a 


For positive integers m,n write mn for the product wmWm4i-..Wm4n-1, and set 
Tr = Tn = W1W2--.Wp. Show that a complex number J is an eigenvalue of T if and 
only if the series 
An 


Rn, 


z 


n=1 


converges, and deduce that the set e(T) of all eigenvalues of T satisfies 


{VEC: [Al < R}C eT) C{AEC: Al < B}, 


where R = liminfy_,.. |a,|!/”. 

Give an explicit expression for T” and express ||T”|| in terms of the numbers Tn n- 
Show that if the sequence (|w,|) is decreasing then the spectrum of T is the closure of 
the set of eigenvalues. [Standard facts about the spectrum of a bounded linear operator, 
including the spectral radius formula, may be quoted without proof.] 
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Solution. Let € = (6:0, 611, 6; 2,...) be the basic vectors in I’. Let € = (&, £1, &2,...), 
let ||w||.0 = sup; |wi|, let € > 0 and choose z such that w; > ||w||.. — «. Then 


Tél = » [eke] S [evlloo 271i S [elloo D1] = lleebcollé lls 


IIe = [wi] = lwilllell > (wll — €)Ilell 
It follows that ||w;|l.o — € < ||Tl| < lw]... and ||T]] = ||wl0.- 


A is an eigenvalue of T with eigenvector € if and only if 79° || < oo and wzéy = A€g_1 
for k = 1,2,.... This is true if and only if 
k 


r foe) 
&1 = and d 


d\n 
a < co (x) 


Now the r.o.c. of > A”"/m, is R = liminf,40 Mm and the series converges absolutely 


for |\| < R and diverges for |\| > R. Therefore 
fAEC:|Al< R}c&(T)C{rAEC: |r] < R} (4x) 


Yad = (intas Tintakis 13 nEn+25 ey Niwlneh ots o- 2 
and ||T"|| = sup{azn : k € N}. 
If |w,| is decreasing then |7,,,| is monotone decreasing in k for fixed n so that 
T"l] = lean] = lr. 


By the spectral radius formula r,(T’) = lim ||TJ"||!/" = lim|z,|/" = R. Since the 
spectrum o(T’) is a closed subset of {A : |A| < R,(T)} it follows from (««) that o(T) = 
e(T’) the closure of the set of eigenvalues. 


Q7 Explain what is meant by a complete orthonormal system in a complex Hilbert 
space. Sketch a proof that the functions 


e,(0) = — (n€Z) 


form such a system in L*(—7, 7). 
For a function f : R - C define Jf : (—1,7) > C by 


(JF)(8) = a(tam (48) + if (tan( 30) 
Show that Jf is in L?(—x, 7) if and only if f is in L?(R) and that 
[NOTIN 40 = [~ Faole) ae 
for all f,g € L’(R). Hence, or otherwise, show that the functions 
1 (i-—<z)" 


frlx) = VaG+ayt (n € Z) 


form a complete orthonormal system in L*(R). 
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Solution. A subset {e,: a € A} of H isac.ons. if (e,,¢3) = 64,9 for all a, 8 € A and 
if the linear span [s[e, : a € A] is dense in H. 


1 2rd : 
=~ [ ei o—1md ma poet 


(€n €m) = 27 Jo 


and {e, :n € Z} is orthonormal. 


By Fejer’s Theorem, Theorem 4.1.16, the Cesaro sums of the Fourier series of a 
periodic function f in C|—z, 7] converge uniformly to f. Thus f may be approximated 
uniformly and therefore in the L?-norm by trigonometric polynomials 6 (ar cosré + 
Gb, sin@) or equivalently by vectors in Isle, : n € Z]. Since the continuous periodic 
functions on [—z, 7] are dense in L?[—x,7] for the L?-norm Isle, : n € Z] is dense in 
LD?(—n, x] and {e,:n €Z} isacoms.. 


[If v is the indicator function of a subinterval of [—1, 7] and € > 0 there is a continuous 
periodic function h (with trapezoidal graph) such that ||v — All, < «. Using the triangle 
inequality it follows that if ¢ € L*‘*?[—z, x] there exists a continuous periodic function 
g such that ||¢ — g|l2 < €. Since L**°?[—z, 7] is dense in L?[—z, 7] so are the continuous 
periodic functions on L?[—z, z].] 


Let f € L’. Using the change of variable « = tan 46 


n7! 


n esse 2tan—*(n) 1 1 pie Oe 
[ t@F@ae = | sec gt GO) + Ds (tan 56) Ftan 58) dé 


2tan—1(n) 


= Me F)(O)(TF)(8) a0 


2tan—1(—n 
Now Jf is measurable, and by the ee Jf € L?[—z,7] if and only if the r-his. 
converges as n —+ oo. This is true if and only if f € L?. This shows that if f € L? then 


J(f) € L?[-1, 7]. Moreover ||Jf||2 = ||f||2 and J is an isometric isomorphism of L? into 
L?[—n, 7]. 


Tt follows by polarisation that (f,9) = (Jf, Jg) whenever f,g € L*. Since 


(J44)(0) = e(tan 50+ ere ae = en(6) 


{fn im € £} is orthonormal. 


If f 1 f, for alln € Z then Jf 1 e,, and Jf = 0 since {e, : n € Z} is complete. 
Since J is an isometry f = 0 and the sequence {f, :n € Z} is a c.o.ns.. 
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Q8 Prove that if T is a bounded linear operator on a Hilbert space H then T*T is 
self-adjoint and |/T*T|| = ||T||?. 
Now let T : L?[0, 1] — L?[0,1] be the operator defined by 


(TAY) = f' Fw)du (¢€(0,1)). 
[ seat 


s 1 
and (T*T f)(s) (1—s) i f(u)dut+ i (1 — u)f(u) du 
0 s 
for f,g € L[0,1] and s € [0,1]. Hence show that if \ is a non-zero eigenvalue of T*T 
then there is a continuous eigenfunction f, which is twice differentiable and satisfies 


AFM s)=—-f(s), F)=0, f'(0) =0. 


Find all the non-zero eigenvalues of T*T and hence calculate |Z'||. [You may assume 
without proof that T*T is a compact operator, and may quote standard theorems about 
compact self-adjoint operators.] 


Show that (T*g)(s) 


Solution. 
(Tx, Ty) = (T*Tz, y) = (a, T*Ty) whenever z,y € H 
and T*T is self-adjoint. For self-adjoint T*T 
|P°T|| = sup (E*T2,2\| = sup (Pe, Ta) = sup |e? = [IP 
I|e||=1 llz| 
If f € L7(0, 1] then 
1 1 t | panini 
a - 
iAP = frn@la= [Lf sem) autt fF) au) at 
SMM OVO Lame du dv d 
=f [ twie)dudvaes ff [lewis duav at 


=(flreoian) =(f" [reol-tau) <FIP 


To find the adjoint of T we first note that 1jo4(u) = ljo,g(¢) whenever t,u € [0,1]. 
Then 
Ph) = [ {oO [ seauh de = f° [roalwiat(u) de 
A ph ern 1 7 a 
= [Pf renldare atau = f° { 09 [' aterath 


and (T*g)(s) = Jt g(t) dt. 


and T is bounded. 
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Similarly 
(T*T f)(s) = ‘a i flu)duat = [ : J teanl@)1o.0(u) Flu) duct 


=f fon )tun®Fw) du dt = (a—s) f° fwaut fa ~ w)F(u)au. 
Let \ be an eigenvalue of T*T with eigenvector f. Then 
As) =(1=s) f° Flu)dut [1 w) fw) du, (*) 
By the F.T.C. f is differentiable (from the left at 0 and right at 1) and 
(8) =— [ flu)du+ (1-3) f(s) --s)f(8) = - [fw du. (+) 


Then f’ is differentiable and Af” = —f. From (x) and (x*) the boundary conditions are 
f(1) = f'(0) =0. 


The solutions of Af” = —f are 
f(s) = acossd~¥/? + bsins\7¥/?, 


where a and 6 are constants. The boundary conditions imply 6 = 0 and acos\~? = 0. 
It follows that the eigenvalues are 


nae eee ee 
(2n + 1)?x? © 


T is compact so by Corollary 5.4.10 


\|Z'|| = max{|A|: \ is an eigenvalue of T} = 4/x’. 
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6.4 1991 


Q1. Let X be a real normed vector space. What is meant by the statement that X is 
a Banach space? 


(i) Show that if X is finite dimensional then X is a Banach space. 


(ii) Show that L7[0, 1] is a linear subspace of L"[0, 1] and determine whether L*(0, 1] 
is complete for the L1-norm. 


Solution. X is a Banach space if every Cauchy sequence in X converges to some 
point in X. 


If X is finite dimensional it has a basis e;,...,e,. Each « € X has a unique repre- 
sentation « = zley +...+2"e,. Let 


k= inf{\lel]: le] =} 


If « = 0 then there exists a sequence z,, € X with > |zt,| = 1 such that lim,,,4. 2m = 0. 
Now |z?,| < 1 for all m andi = 1,...,n so by the Bolzano-Weierstrass theorem has a 
subsequence convergent to z' for each i. Moreover > |z‘| = 1. Since this subsequence 
also converges to 0 we may take it to be {z,,}. If c = Yo z'e; then 


nr 
[2m — 2|| < Doz, — 2*| + 0 
1 
as m—+ oo. Therefore z = 0 and z' = 0 for i =1,...,n. Therefore 3 |z‘| = 0 which is 
a contradiction. It follows that « > 0. 
If 2m is a Cauchy sequence in X then 
lem — el] > «Cla, — ai] 0 m, k 00. 


It follows that {xi} is Cauchy convergent to z' fori = 1,...,n. If ¢ = Yoa'e; then 
tm — || < D(z, — 2') - 0 as m > co. Therefore X is complete. 


E7(0,1] = {f : f is measurable and f? € L*[0,1]}. If f € L?[0,1] then f = 
mid{—(1+ f?), f,1+ f*} € L [0,1] since f is measurable. 


Let f(x) = 27? and f,(x) = f(x) for x € [1/n,1] and zero for x € [0,1/n). Now 
f, € L*(0, 1] since it is continuous on [1/n,1]. Now 


mat Ilfn = Falla = 2 im, |n-1/2 -_ m2 270) 


Therefore (f,,) is Cauchy for the L!-norm. 
Now by the FTC ff f, = 2(1—4/1/n) > 2asn — oo. By the monotone convergence 


theorem f € L*[0,1] and ||f — falli = JO |f — fal tends to 0 as n > oo. Therefor 
(fn) C L?[0,1] is a Cauchy sequence for the L!-norm convergent to f € L1{0,1]. Now 
So f2 =logn and f ¢ L?[0,1]. Therefore L?{0, 1] is not complete for the Z'- norm. 
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Q2. Define the dual X* of a real normed vector space X. 


(i) Let [! be the real normed vector space of infinite sequences: 


= { (ia): > lee < oo}, with [I(e.)l| = = leah 


and with coordinatewise addition and scalar multiplication. Show that there exists an 
isometry T from [°° onto (I)*. 


(ii) Let X x X and X* x X* be respectively the normed vector spaces: 
XxX = {(21, 02): 2; € X}, with ||(e1,72)|| = |leal| + [lzall, 


X* x X* = {(¢1, $2) : $i € X*}, with ||(¢1, 42)|| = max{||drll, [ldall}, 


with coordinatewise addition and scalar multiplication. Show that there exists an isom- 


etry 6 from X* x X* onto (X x X)*. 


Solution. The dual space X* of X is the vector space of continuous linear functionals 
on X with the norm 


I|¢l| = sup{|¢(x)| : 2 € X, |x|] = 1} ge X*. 


(i) Let 1° be the normed vector space of complex sequences a = {a,} such that 
lal] = super lan| < co. If a € I and x = {z,} € 1 then 


|e antal <S° lantal < sup{lan||} 5° len] = [lz lla. 
Therefore the formula 


T(a)(z) = Danes le {3} € P. 


defines t(a) € (1)* with ||r(@)|| < |lall. If e* = {6.,} € T then |le*|| = 1 and 


is surjective. Thus (I')* is isometrically isomorphic to [°. 


(ii) Let Y = (X x X). Define 6: X* x X* + Y* by 6(¢4, $2)(21, 22) = ¢1(21) + 
$2(z2). Then 


1or(e1) + ba(e2)| < [orl [eal + Idall Ileal < I(¢2, ¢2)I II(e1, 22) 
and ||(¢1, $2)l] < [I(¢1, ¢2)Il- Hf [I(¢1, 42) || = Ildal] say, then sup{0(¢1, ¢2)(z, 0) : |le|| = 


1} = ||¢i|| and @ is isometric. If ¢ € Y* and 4;(x) = ¢(z,0), ¢2(x) = ¢(0,2), then 
& = 9(¢1, $2) and @ is onto. 
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Q3. State the Hahn—Banach Theorem for real separable normed vector spaces. 


Suppose that X is a real separable normed vector space whose dual space is X*. If 
S is a subset of X the annihilator of S is 


S° ={f € X*: f(x) = 0 whenever zx € S}. 


Let T : X — X be a continuous linear transformation with finite dimensional range. 


Show that (ker T’)° = Im(7*), where T* is the dual of T. 
Let U: 0 + T be the linear transformation defined by the formula 


for n odd, 


for n even. 


A 
U(tn) = (Yn) where y, = { . Ln, 
Show that U is continuous, and find kerU. 


For (a,) € 1° determine U*(a,). Find Im(U*) and determine whether or not 
(ker U)° = Im(U*). 


Solution. Hahn-Banach Theorem. Let fo be a continuous linear functional defined on a 
linear subspace L of a normed vector space X. There exists f € X* the dual space of 
X such that f(x) = fo(x) whenever x € L and such that ||f\| = || foll- 


If f,g € S° and a,f € R then (af + Bg)(x) = af(x) + Bg(z) = 0 whenever 
z € §. Therefore S° is a linear subspace of X. If f, € S° converges to f € X* then 
lf(x)| = |f(z) — fr(x)| < If -— fall llz|| ~ 0 as n — co whenever x € S. Therefore 
f(x) = 0 and f € S°. Therefore $° is closed in X*. 


If f € X* and a € kerT then (T* f)(x) = f(x) =0 and T*f € (kerT)°. Therefore 
ImT™* C (ker T)°. 


If g € (kerT)° then the formula fo(Tz) = g(x) whenever x € X defines a linear 
functional on ImT. Since ImT is finite dimensional fp is bounded and has a bounded 
extension to f € X*. Then (T* f(x) = = f(Tx) = fo(Tr) = g(x) whenever x € X. 
Therefore T* f = g, and (ker T)° C ImT*. 


WW {ed = Xleongs|/22"4? < D|e,| = ||{z,}|| and U is bounded and therefore 


continuous. 


The dual of ¢* is isomorphic to £°: if ¢ € (¢1)* there exists 7 = (n,) C €° such that 
$(€) = kam for all € = (€,) € €'. Let e, € £1 and e, € £© be 1 at the nth entry and 


zero elsewhere. Then 
(U*e;)(e;) = e(Ue;) = 6;;/2’ if j is odd 


and 0 if j is even. Therefore U*e; = 1/2' if 7 is odd and 0 otherwise. Direct verification 
shows that U*{a,} = {6;} where 8; = a;/2' if i is odd and 0 if ¢ is even. 


ELL 


Now kerU = {{zn} € @ : tong: = O} and (kerU)° = {{¢,} € &° : don = O}. If 
én = 1 for n even and 0 for n odd, and {¢,} = U*({an}) then az, = 22" so that 
{an} ¢ £°. Therefore (ker U)° #4 ImU*. 


Q4. Calculate the Fourier series of e? on [—7,7]. At what points of [—7, x] does 
this series converge and to what limits? 


Sum the series 


ss L 
> L+n 
State Parseval’s equation. By considering the function cosh z, or otherwise, sum the 
series 


= 1 


Solution. The Fourier coefficients a, and 6, are given by 


On, =i e’ cos nt dt = [e' cosnt]”, + [ne! sin nt]” .-f ne‘ cos nt dt 
Tr, = e' sin nt dt = {e' sinnt]",, — [ne cosnt]”™ gap n’e‘ sin nt dt 
oe 2 sinh 2n sinh 
s 
Ree inh + = yynt12n sin ua 
w1+n? mi+n? 


The Fourier series for e” is 


sinh + cosnz  nsinnz 
2 ig — ——_—_ ]}}. 
mth YI 4) (es 1+n? ) 


e* is of bounded variation, satisfies Dini’s condition, and is piecewise continuously dif- 
ferentiable so by Theorem 4.1.8 or by Theorem 4.1.12 the Fourier series converges to e” 
on Cr, m) and to coshm at +7. 


pheretone 


sinh 7 cos nit 
h 2 ee : 
cosh 7 = aap + 3G 1) iz | 


1 sas 1 
3(m coth x — 1) = er 


Parseval’s equation(Corollary 4.1.22: f"_ |f(x)|? dx = a3/2 + 3°3°(a2, + 62) where an, bp 
are the Fourier coefficients of f € Dn, TI. 
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If f(x) = coshz then b, = 0 and a, is as above. Using Parseval’s equation 


i ft ae ee 1 
~ [ cosh? x de = - f{ =(1+ cosh 2x) dz = 1+ — sinh2x 
T Jon T Jon 2 20 


= sinh 1 \’ 2443 1 
~ T 7 (1 +n?) 
1 


» (+n? = ol a 5 sinh 2r]cosech? x — 5 


and 


Q5. If « € [—7, 7] and n =0,1,2,..., let 


i i 1 —cos(n + 1)z 
=— >, Ae) = 
2singx (2) 4(n + 1)(sin $2)? 


Let f : [—2,72] — R be continuous with f(r) = f(—7). Let 
1 nr 
ole) = 500 + So (ax cos kx + b, sin kz) 
k=1 


and 
1 


aes (s(x) +...+8n(2z)) 


where a,b, are the Fourier coefficients of f. Show that 


cm =f" f(z +t)D,(¢) dt, 


Ole) = 


and -_— 
on(z) = = a _f(e +) F(#) dt. 
Show further that o,,(a) is uniformly convergent to f(x) on [—7, 7]. | 


9 D(x) and that ft F(t) dt = 1/2.] 


[You may assume that F,,(z) = ay 


Solution. Extend f to a continuous periodic function on R. Now 
D,(z) = 3+ Lj coske and F,(x) = 4y DG Dp (2). 
The integrals follow immediately. Now the partial sum 


1 n 
Ce 500 + ) (a, cos kx + b, sin kx) 
k=1 


lyr n 
= =f FOL + }o(cos kt cos kx + sin kt sin kx)} dt 
aa k=1 


~ =o AO + Di cosk(é ns =f" f(t)Dn(t — x) dt 


= : if : f(x +)D,(t) dt 


since f and D,, have period 27. 
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1 
n+1 


== [fe +) (Delt) +... + Dal@) at 


(so(x) +...+5,(2)) at eee 


oft) = 


=-[ " fe +F(t) dt 


Given € > 0 there exists 6 such that |}(f(a +t) + f(x —t)) — f(z)| < € whenever 
0<t <6 for all z € [—7, x]. Therefore 


on(2) - fla) == [Ge +t) + fle — 8) — Fe) FACt) at 


=2 PEue+H +e) fer ats= [Cet +fe-)- fe) RO a 


<= f rats = [Gu@+)+ fe-0) — fe) Eat 


since F;, is a non-negative function. 
If0<6<a<7 then 


1 —cos(n + 1)x 
4(n + 1)(sin $x)? 


1 


ane San + Gin BoP 


converges to zero uniformly as n —+ oo. By the dominated convergence theorem the 
second integral above tends to zero as n — oo. Therefore o,(z) converges uniformly to 


f(z). 
Q6. Explain what is meant by a complete orthonormal sequence in a Hilbert space. 


The sequence of Laguerre functions (y, : n = 0,1,2,...) is defined by 
et/2 d” 


nt dx” 


Pale) (a"e~*) : eo Oe OD nos 


You may assume that (y, :n = 0,1,2,...) is an orthonormal sequence in L[0, co) 
with generating function 


1 
e€ 
1-—¢t 


—fa(t)c 


o(2,t) = dten(2) = 


where a(t) = (1++¢)/(1—t). You may further assume that for each t € (—1, 1) the series 
converges to g(a, t) everywhere in [0, 00) and also in L?-norm. 


Show that if f € L*[0, 00) and f° f(x)y,(z) dx = 0 forn = 0,1,2,... then f5° f(x)e~** dx 
= 0 foralla>0. 
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Consider the change of variables y = e~*. Using the fact that if f € L?[0,00) 
and h(y) = y~?f(—logy) for y € (0,1] then h € L?[0,1], or otherwise, show that the 
Laguerre functions are a complete orthonormal sequence in L?(0, 00). 


[You may assume that the polynomials are dense in L?[0, 1].] 


Solution. A sequence (z,) in a Hilbert space H is orthonormal if (t,,2m) = dmn 
whenever m,n EN. It is complete if « € H and (x,z,) = 0 for alln € N implies x = 0. 


ee (2) e~ 2l(1tt)/(A-t)]e 
Prlt) == 
n=0 to 


for each z € [0,00) and ¢ € (—1,1). 


Let a = $(14+1¢)/(1—t). Then a runs from 0 to oo as ¢ runs from —1 to +1. By 
the continuity of the inner product 


[ t@ertar = (1-1) ye [° #@e@) ae =0, esi 


Suppose f is as above. Using the transform y = e~* the function g(y) = y~?2 f(—log y) 
is in L7(0,1] and fo° |f(«)|? de = Jo |g(y)|? dy. Then 


[ f@ee de = [ our} ay = 0. 


Therefore g L P, the subspace of polynomials on [0,1]. By the Weierstrass approxima- 
tion theorem, Theorem 4.1.24, or by a direct proof, P is dense in L?[0,1]. Since the 
inner product is continuous g = 0 in L*[0,1]. Therefore f = 0 in L?[0,00). This is the 
above condition for completeness of an on. sequence. 


Q7. Let T be a continuous linear transformation in a complex Banach space. Show 
that the spectrum o(T) is a closed subset of {A € C: |A] < ||T Il}. 
For f € L*[0, 00) and z € [0, ov) let 


(Sf)(z) f(z +1) 
(Tf)(z) f(x) + f(x + 2). 


Show that S and T are continuous linear transformations of L*({0, 00), and find ||.$|| and 


o(S), and ||T|| and o(T). 


[You may assume that o(p(T)) = {p(A) : \ € o(L)} whenever p is a complex polyno- 
mial.| 


Solution. If ||T|| < 1 then the series 1° ||T'||” is convergent to (1 — ||T||)~?. By the 
M-test >°>° 7” is convergent in the operator norm to a continuous operator R,. Then 


I~ T)R, = lim, .0(I —T) 3 T* = lim,..o(f — T**!) = 1 = R(T —T). 
0 
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Similarly if ||T|| < A then \J — T = \(I — T/A) is invertible with bounded inverse 
Ry. Therefore o(T) is a subset of {A € C : JA] < |/TI]}. 


If A € p(T) the resolvent set of T, and [| ||Ra|] <1 then 
((u — AI -T) = QI-T)(uR, — I) 
and p— € p(T). Therefore p(T) is open and o(T) is closed. 

If f € L¥[0, 00) then ||S'fl] = EIS f(2)| de = [2° fla + 1)| de < =? |fla)| de = |If 
with equality if f(x) = 0 on [0,1). Therefore S is bounded with ||S|| = sup{||Sf]| : 
fl] =1} =1. 

If |A| < 1 and f € L[0,1) then extend f to the whole of (0.00) by putting 

f(e@ +n) =A" f(z) whenever «x € [0,1). 
Then Sf(z) = Af(x). Now 


f e@lae= (ela) Sar a=pyr fy @ee. 


By the monotone convergence theorem f € L*[0,00). Therefore \ € o(S) C{AEC: 
|A| < |] S|] = 1}. Since o(S) is closed o(S) = {\ EC: |A| < 1}. 


Since T = I + S? it follows from the spectral mapping theorem for polynomials, 
Theorem 5.2.11, that o(f) = {A €C:|A—1| < 1}. 


It follows that ||T|| > 2. If 0 < f € L*[0,co) with f = 0 on (0,2) then ||Tf|| = 
So° (F(x) + F(x + 2)) dx = 2\|f|| and ||T|| = 2. 


Q8. Let D be the subspace of L*[0,1] consisting of those complex-valued square- 
integrable functions y, such that y(0) = y(1) = 0 and such that y/(rz) = fy f(s) ds for 
some f € L?(0,1]. Define the linear transformation L : D — L?[0,1] by the formula 

(Ly)(z) =—-y"(z) ae., y € D. 


Show that DL has an inverse G : L*[0, 1] - L?[0,1] which can be written in the form 


1 
(GA2)= ff o(x,s)F(s)ds, Ff € 10,1), 
for some function g which you should determine. 


State without proof a theorem which implies that G is compact self-adjoint and 
determine the spectrum of G. 
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[You may assume that if f € L'[0,1] then F(z) = fo f(s) ds is continuous, differentiable 
almost everywhere, and that F’(r) = f(z) ae..] 


Solution. Suppose f € L?[0,1] and that y € L7[0,1] with y(0) = y(1) = 0 and y"(z) = 
—f(x) a... Integrate twice to get 


y(xz) = — [ [ f(s) ds dt + y'(0)z. (6.6) 


Since y(1) = 0 it follows that y'(0) = Jo So f(s) ds dt. Interchanging the order of inte- 


eention 
y(t) = -[ [aeyatds=e ff f(s)atas 
a [sa—ayt(syds + f(a - »)F(s)as 
Therefore 
v(x) =f 9(2,5)f(s) ds, (6.7) 
where 


GN s(l—z), 0<s<e 
Wey z(l1—s), r<s<l. 


If y is given by (2), then reversing the order of integration leads back to (1), and 
differentiation shows that y” = —f a.e.. 


It follows that LGf = f whenever f € L7(0,1]. If y € D then Ly € L*[0, 1] so that 
Ly = LGLy. Since L is injective it follows that y = GLy and G is the inverse of L. 


Theorem 5.5.2. Let g € L?({0,1] x [0,1]) with g(x,y) = g(y,x) for almost all 
(x,y) € [0,1] x [0,1]. the formula 


Gf (x) = [ g(x,s)f(s)ds ae. whenever f € L*[0, 1], 


defines a compact linear operator G : L*[0,1] — L*[0, 1]. 


Now g is a symmetric L*-kernel so that G is a compact self- adjoint operator in 


(0, 1]. 


Since G is compact its spectrum consists of non-zero eigenvalues and possibly the — 
point 0, Corollary 5.4.12. It is immediate that ker G = {0}. Suppose is an eigenvalue of 
G. The associated eigenspace is finite dimensional. If f is an eigenvector then Gf = Af 
so that f = LGf = ALF and conversely. 


LAd. 


Consider the equation 


(L— ply =y" + py =0 y(0) = y(1) =0. 
The general solution is 
az + 6, pp =O0 
y= 4 acos,/uz + bsin,/pz, p>Od 
aexp(./—pa + bexp—./—pr, w <0. 
27? n = 1,2,..., and the eigenvalues of G are 


From the boundary conditions p = n 


ae ade 2 ae 
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